JP5019130B2 - Image reproduction apparatus and program - Google Patents

Description

  The present invention relates to an image playback apparatus and program, and more particularly to an image playback apparatus and program capable of playing a moving image in addition to a still image and playing a digest version of the moving image.

  2. Description of the Related Art In recent years, there are an increasing number of digital cameras and other imaging devices capable of recording and storing images (moving images) with movement in addition to still images. Have come to be stored together.

  By the way, when reproducing a still image or a moving image, the original image (still image or moving image) of the representative image is reproduced by selecting a desired representative image from a list of representative images (thumbnail images) of those images. However, long-time video playback, especially playback of long video that has been taken continuously, can cause mental pain.

  Therefore, Patent Document 1 below discloses a playback apparatus that can play back a moving image partially like a digest version.

  Hereinafter, when this playback apparatus is referred to as a prior art, in this prior art, first, still image data as a flag is recorded in association with moving image data. Then, in the slide show mode in which still image data is sequentially reproduced, moving image data within a predetermined time range recorded in association with each still image data is sequentially reproduced instead of each still image. As a result, the moving image data can be partially reproduced as in the digest version, enabling efficient viewing and reducing mental pain.

JP 2005-117083 A

  However, in the prior art, when partially reproducing moving image data, still image data recorded in association with the moving image data is not reproduced, and the original role of still image data for viewing a subject cannot be played. .

  Accordingly, an object of the present invention is to enable viewing of all image data associated with moving image data while efficiently viewing moving image data.

The invention described in claim 1 is related to each other, the first moving image data having a first reproduction time, the second moving image data having a second reproduction time shorter than the first reproduction time, and a still image In an image reproduction apparatus comprising recording means for recording each image data of data and display means for displaying the image data, any one of the first moving image data, the second moving image data, and the still image data When the image data is displayed on the display means, the selection means for selecting other image data associated with the currently displayed image data, and the other image data selected by the selection means and and a display control means for displaying on said display means, said in the recording means, in the first moving image data, a plurality of time indicators showing different reproduction time, respectively one another serial The second moving image data is a plurality of moving image data in the second reproduction time before and after each reproduction time indicated by the plurality of time indexes in the first moving image data, The still image data is an image reproducing device characterized in that the first moving image data is a plurality of still image data at each reproduction time indicated by the time index .
Invention 請 Motomeko 2 wherein, said selection means, said when the display unit the first moving image data is displayed, the first moving said second data to the associated video data or the still Image data is selected, and when the second moving image data is displayed on the display means, the first moving image data or the still image data associated with the second moving image data is selected, and the display when the still image data is displayed in the unit, according to claim 1, wherein said associated with the first moving image data a first moving image data or the selecting the first video data, characterized in that This is an image reproducing apparatus.
According to a third aspect of the present invention, when the selection unit displays image data of any one of the first moving image data, the second moving image data, and the still image data on the display unit. In addition, when other types of image data are selected, image data to be displayed can be selected from other types of image data based on the time information of the currently displayed image data, 3. The image reproduction device according to claim 1, wherein the display control means displays the image data selected by the selection means in the order of times indicated by the time index.
According to a fourth aspect of the present invention, the first moving image data having the first reproduction time, the second moving image data having the second reproduction time shorter than the first reproduction time, and the still image are associated with each other. A computer comprising recording means for recording each image data of the data image data and display means for displaying the image data is selected from the first moving image data, the second moving image data, and the still image data. When the image data is displayed on the display means, the selection means for selecting other image data associated with the currently displayed image data, the other image data selected by the selection means, to function as a display control means for displaying on said display means, said in the recording means, the in the first moving image data, a plurality of time indicators showing different playback times respectively with each other And the second moving image data is a plurality of moving image data for the second reproduction time before and after each reproduction time indicated by the plurality of time indexes in the first moving image data, The program is characterized in that the still image data is a plurality of still image data at each reproduction time indicated by the time index, which constitutes the first moving image data .

  According to the present invention, it is possible to view all the image data associated with the moving image data while efficiently viewing the moving image data.

  Embodiments of the present invention will be described below with reference to the drawings.

<Prerequisites for shooting>
Prior to the description of the embodiment, the configuration of three types of images (a normal moving image, a digest version moving image, and a still image) used in this embodiment will be described.

  Incidentally, a “normal moving image” refers to a moving image that is continuously shot for an arbitrary time. The arbitrary time is not particularly limited. The maximum time generally depends on the capacity of the recording medium. There are various cases of shooting “normal video”. Typically, this is a case where the motion itself is desired to be recorded, but other than that, for example, it is also used when shooting a scene including a photo opportunity that is not to be missed. This is because such a photo opportunity can be left as a frame image by shooting at least “moving image”. However, since a frame image of a moving image has a coarser image quality than a normal still image, a high-quality “still image” is shot during shooting of a “normal moving image” (so-called still-in movie).

  On the other hand, the “digest video” is a video in a predetermined range before and after the still-in-movie shooting time point (that is, the still image shooting time point during moving image shooting). It is a combination. The still image shooting time point during movie shooting is the time of the shutter chance and the point of interest of the photographer, so in the end, the digest version movie is the part that you want to see exclusively with the normal movie shot without a dull end It can be said that it is a movie that can be enjoyed only by watching.

FIG. 1 is a diagram illustrating the configuration of three types of images used in the embodiment.
First, a “normal video” is a collection of frame images that are sequentially photographed at a predetermined cycle (for example, N frames per second, that is, N [fps]) along the time axis from the left to the right of the drawing. Video). Here, a general frame period of a photographing apparatus such as a digital video or a digital camera is N = 30, for example. However, for convenience of explanation, it is assumed that N = 1. That is, it is assumed that the normal moving image is composed of a large number of frame images taken at intervals of 1 second (sec).

  A square frame of a normal moving image schematically represents each frame image, and a number written in the frame indicates an identifier (frame number) of each frame image. For example, the illustrated normal movie is: 1, 2, 3, 4, 5, 6, 7, 8,... 51, 52, 53, 54, 55, 56, 57, 58,. Frame image.

  Next, the “still image” is a frame image of a normal moving image (frame number “4” in the illustrated example) taken at an arbitrary time point during normal moving image shooting, for example, two time points Ta and Tb in the figure. And “54”). Time points Ta and Tb are execution timings of the still image shooting operation performed by the user.

  Finally, the “digest movie” is a movie composed by cutting out images of several frames before and after the still image shooting time (Ta, Tb in the illustrated example) from normal movies and connecting them. The number of cut-out frames is not particularly limited, but here, as an example, it is assumed that 6 frames are cut out before and after, that is, 6 frames. Therefore, in the illustrated example, the first frame group from frame numbers “2” to “7” corresponding to the time point Ta and the second frame from frame numbers “52” to “57” corresponding to the time point Tb. Groups are cut out, and a digest version moving image is formed by connecting the first and second frame groups.

  Here, the above three types of images (normal movie, digest movie and still image) can be defined as follows. First, a normal moving image is a moving image in which shooting is continued for a certain period of time in order not to miss a valuable photo opportunity, in other words, including shooting unnecessary portions. On the other hand, a still image is a high-quality image at the moment of a precious shutter chance that was visited during the shooting of the normal moving image. On the other hand, the digest version moving image is a moving image before and after the moment of the photo opportunity, and when there are a plurality of photo opportunities, the moving images before and after the moment of the photo opportunity are connected. .

  Therefore, these three types of images (normal moving image, digest version moving image and still image) can be used (reproduced) according to their respective colors. That is, a still image is a high-quality picture that does not move and captures the moment of a photo opportunity, and is suitable for viewing details of a subject on a screen or printing out. On the other hand, although the digest version video is slightly inferior to still images, it can be seen efficiently by extracting the movement of the subject before and after the shutter chance, and if the audio can be recorded simultaneously, the voice of the subject etc. Since environmental sounds can be heard together, it is preferable in that you can experience a realistic atmosphere. Furthermore, normal videos include useless parts, but are unedited live videos. For example, subjects that were not noticed and subject movements may be captured, and were not intended at the time of shooting. This is preferable because an unexpected photographing result may be obtained.

  In this way, there are three types of images (normal video, digest version video and still image) each having a unique color, but in the prior art described at the beginning, transition between images, that is, normal video, There was no means for freely switching between the digest version movie and the still image, and it was difficult to deny the usability.

  Therefore, in this embodiment, as will be described in detail below, a user operation (still image shooting operation) such as a still-in movie performed during shooting of a moving image (a normal moving image) shot with a dullness is triggered. As a (trigger), a moving image is taken for a predetermined time (for example, several seconds), a digest version is generated by connecting the moving images, and is stored as another moving image data.

  Further, the captured still image, the normal movie, and the digest version movie are stored in association (also referred to as association), and at the time of playback, based on the associated information, still image playback, normal movie playback, digest version The user can freely switch the playback of the video.

<Configuration>
Next, the configuration of the present embodiment will be described.
FIG. 2 is a block diagram of the photographing apparatus according to the present embodiment. In this figure, the photographing device 1 is a digital camera, for example, capable of still image photographing (still-in movie or the like) during moving image photographing. The photographing device 1 includes an imaging unit 2 and a monitor display image processing unit 3. , Display control unit 4, display unit 5, still image processing unit 6, central control unit 7, moving image processing unit 8, FIFO memory 9, trigger generation unit 10, gyro unit 11, operation unit 12, stream control unit 13, recording medium A control unit 14 and a recording medium 15 are included.

  In addition to this, for example, an input / output unit and a power supply unit for exchanging data with an external device such as a personal computer are included, but the description thereof is omitted for the sake of illustration.

  The details of each unit will be described. The imaging unit 2 includes a two-dimensional image sensor such as a CCD or CMOS, and also includes a communication control unit with the image sensor, a Bayer data reading unit, a development processing unit, and the like. A frame image with a predetermined period (for convenience of explanation, one frame per second) is output as a through image for composition confirmation or an image for a moving image, and the image quality is high in response to a still image shooting operation (such as a shutter operation) by the user. The still image can be output.

  The monitor display image processing unit 3 performs image processing such as resizing and color conversion on the image data from the imaging unit 2, shapes it into a shape suitable for monitor display for composition confirmation (through image), and displays it. The control unit 4 performs control to display data (through image) from the monitor display image processing unit 3 on the display unit 5.

  The still image processing unit 6 performs image processing such as resizing, color conversion, and compression processing (for example, JPEG) using data from the imaging unit 2 in accordance with an instruction from the central control unit 7, and a still image for one sheet. Data is generated, and the moving image processing unit 8 performs image processing such as resizing, color conversion, and compression processing (for example, H.264) using the data from the imaging unit 2, and generates a moving image stream.

  The FIFO memory 9 is a first-in first-out memory, and the FIFO memory 9 has a capacity sufficient to hold a moving image stream from the moving image processing unit 8 for a first predetermined time. In the present embodiment, the first predetermined time is assumed to be 5 seconds, but the present invention is not limited to this. The first predetermined time may be arbitrarily set for each application to which the present invention is applied.

  The trigger generation unit 10 detects a trigger in response to a user operation (still image shooting operation) such as a still-in movie, and the trigger is, for example, data from the imaging unit 2 or data from the gyro unit 11. Can be detected.

  In other words, when there is a large change between frames, such as by obtaining the difference between frames using data from the imaging unit 2, or when a “triggered” is detected, or when a specific subject appears in the frame Or “triggered” can be detected. When the “triggered” is detected, the trigger generating unit 10 notifies the central control unit 7 of the fact. Alternatively, when the data from the gyro unit 11 is used to determine whether or not the photographing apparatus 1 is in the middle of pan / tilt or large camera shake and when it is detected that the photographing apparatus 1 is stationary, “triggered” May be detected. Also in this case, the trigger generation unit 10 notifies the central control unit 7 that “triggered” is detected. Incidentally, the gyro unit 11 is a block including a gyro sensor, gyro sensor control, and the like, and acquires information such as a posture change of the photographing apparatus 1.

  The input to the trigger generation unit 10 is not limited to the above example, and there are various methods such as generating a trigger by inputting voice data from a microphone (not shown) and detecting the change. Conceivable. The trigger detection method and detection conditions are not limited to the above, and any method may be used.

  The central control unit 7 is a part that performs overall control of the photographing apparatus 1, receives a detection notification from the trigger generation unit 10, and inputs various operation signals from the operation unit 12 (shutter keys and digest version moving images). Process the input such as generation permission key). The configuration of the central control unit 7 is not specifically limited. For example, the central control unit 7 may be a so-called CPU including a microprogram control computer and its peripheral devices, or may have all or part of the functions of the program. It may be configured with hard logic.

  The stream control unit 13 controls whether or not to output a moving image stream via the FIFO memory 9 in accordance with an instruction from the central control unit 7.

  The recording media control unit 14 receives still image data sent from the still image processing unit 6, a moving image stream sent directly from the FIFO memory 9, a moving image stream sent from the stream control unit 13, and sent from the central control unit 7. Control to write various information (still image file name, normal moving image file name, digest version moving image file name, association data table 20, digest version moving image index table) to the fixed or removable large capacity recording medium 15 I do.

<Recording process>
Next, the “recording process” in the operation of the photographing apparatus 1 of the present embodiment will be described.

  3 and 4 are diagrams showing an operation flow of the central control unit 7. This operation flow shows processing when the user starts moving image shooting. When the user starts moving image shooting, first, the operation of the moving image processing unit 8 is started, and the normal moving image file name is notified to the recording media control unit 14 (step S1). The recording medium control unit 14 assigns an arbitrary file name (hereinafter referred to as a normal moving image file name) to the moving image stream directly sent from the FIFO memory 9, that is, the normal moving image, and stores it in the recording medium 15. Then, the central control unit 7 resets and starts the normal moving image shooting time management timer (step S2).

  Here, the normal moving image shooting time management timer is a general counter built in the central control unit 7 and is a timer for managing the elapsed time from the start of shooting of a normal moving image. Further, the central control unit 7 newly generates an association data table 20 described later in a work memory (not shown), and writes a normal moving image file name therein (step S3).

  FIG. 5 is a conceptual structural diagram of the association data table 20, and the association table 20 has a table structure for indicating the correspondence between the normal moving image file, the digest version moving image file, and the still image file. . That is, the association table 20 includes a normal moving image file name field 20a, a digest version moving image file name field 20b, a still image file name field 20c, and a normal moving image elapsed time field 20d for defining the mutual relationship between these files. A digest version moving image index information field 20e.

  Returning to the operation flow again, the central control unit 7 subsequently determines whether or not the user has finished moving image shooting (step S4). If the end operation has not been performed, it is next determined whether or not the shutter key for still image shooting has been pressed (step S5). If the shutter key is pressed, the central control unit 7 instructs the still image processing unit 6 to generate one still image, and the recording media control unit 14 has an arbitrary file name (hereinafter referred to as a still image file name). Is notified (step S6). The recording media control unit 14 assigns the still image file name to the still image data sent from the still image processing unit 6 and stores it in the recording medium 15.

  Further, the central control unit 7 writes the still image file name and still image shooting time information in the association data table 20 (step S7). Still image shooting time information can be obtained by referring to a normal moving image shooting time management timer and acquiring an elapsed time from the start of normal moving image shooting.

  Next, the central control unit 7 checks the state of the digest version moving image generation permission key (step S9). The digest version moving image generation permission key input is a binary signal that can take two states of “permitted” and “prohibited”. If the digest version moving image generation permission key is “permitted”, the central control unit 7 instructs the stream control unit 13 to start stream output (step S10). When the stream control unit 13 receives this instruction, digest version moving image generation is started.

  After transmitting the command to the processing unit, the central control unit 7 determines whether or not to generate a digest version movie for the first time after starting to capture a normal movie (step S11).

  If it is the first time, the digest video recording time management timer is reset (step S12), and an arbitrary file name (hereinafter referred to as digest version video file name) is written in the association data table 20 (step S13). If the digest moving image shooting time management timer is not started for the first time (step S14), the digest moving image shooting time management timer is started (step S14) by passing step S12 and step S13.

  The digest movie shooting time management timer is a general counter built in the central control unit 7 as with the normal movie shooting time management timer, and is a timer for managing the total shooting time of the digest version movie. is there.

  As described above, the central control unit 7 starts the digest video shooting time management timer regardless of whether or not the digest version moving image generation is the first time (step S14), but if the digest version moving image generation is not the first time, Since S12 (reset of digest video recording time management timer) is passed and the digest video recording time management timer is started (step S14), the digest video recording time management timer continues from the previously counted time. And start counting.

  Next, the central control unit 7 writes the digest version video start time information and the index information in the association data table 20 (step S15), and further stores the digest version video start time information in the digest version video index management table 21 described later. Is written (step S16). The digest version video start time information is information for recording the time when the digest version video was started, and is obtained by referring to the normal video recording time management timer (elapsed time from the start of normal video recording). Time).

  FIG. 6 is a conceptual structural diagram of the digest version moving image index management table 21. The digest version moving image index management table 21 is a table in which chapter information (index information) for managing the scene break positions of the digest version moving image is collected, and includes an index field 21a and a time field 21b. In the illustrated example, index information (index X, Y, Z) for convenience is stored in the index field 21a, and time information (index X → 00: 00: 0) corresponding to the index information is stored in the time field 21b. , Index Y → 00: 00: 10, index Z → 00: 00: 20).

  Returning to the operation flow again, next, the central control unit 7 resets and starts the digest moving image generation time management timer (step S17), and then returns to step S4 again to determine whether the moving image shooting is finished. .

  The digest movie generation time management timer is a general counter built in the central control unit 7 and counts the shooting duration time from the start of the digest version movie shooting. Since the FIFO memory 9 of this embodiment can store a video stream for 5 seconds, at the start of the operation of the stream control unit 13, generation starts from a video stream 5 seconds before the start time (only 5 seconds in the past). Will be.

  On the other hand, if the decision result in the step S9 is NO, that is, if the digest version moving image generation permission key input is in the “prohibited” state, the process returns to the step S4 again without performing any processing, and the moving image shooting is ended. Judging.

  If it is determined in step S5 that the shutter key is not pressed, it is determined whether there is a detection notification from the trigger generation unit 10 (step S8). The same processing as described above is performed from the state where the digest version moving image generation permission key is checked (step S9). If there is no detection notification from the trigger generating unit 10, the digest moving image generation time management timer starts. It is determined whether or not a second predetermined time has passed (step S18). Here, the second predetermined time is a time sufficiently exceeding the accumulation time (first predetermined time) of the FIFO memory 9 and is, for example, 10 seconds, which is twice the first predetermined time.

  If the second predetermined time has not elapsed, the process returns to step S4 again to determine whether or not the moving image shooting has been completed. On the other hand, if the second predetermined time has elapsed, the digest moving image generation time management timer Is stopped (step S19), the stream control unit 13 is instructed to pause (step S20), and the digest moving image shooting time management timer is temporarily stopped (step S21), and then the process returns to step S4 again. It is determined whether shooting has been completed.

  As described above, at the start of the operation of the stream control unit 13 in step S10, the output of the video stream before the first predetermined time (5 seconds) before the shutter press is started by the stream control unit 13, When the second predetermined time (10 seconds) elapses from the start of the operation of the control unit 13, a video stream of 5 seconds before and after the shutter is pressed having a length corresponding to the accumulation time (first predetermined time) of the FIFO memory 9 is generated. It is generated.

  If the second predetermined time has not elapsed since the start of the digest movie generation time management timer (NO in step S18), no processing is performed, and the process returns to step S4 again to finish moving image shooting. If the moving image shooting has not been completed, the same processing (step S5 to step S21) as described above is repeated.

  On the other hand, when the moving image shooting is finished (YES in step S4), the normal moving image processing unit 8, the digest moving image processing unit 8 and the stream control unit 13 are stopped (step S22, step S23), and the digest moving image generation time. The management timer, digest movie shooting time management timer, and normal movie shooting time management timer are stopped (steps S24 to S26). Then, the association data table 20 and the digest version moving image index management table 21 are output to the recording medium control unit 14 (steps S27 and S28), and the recording medium control unit 14 stores these tables in the recording medium 15 for processing. End.

  FIG. 7 is a diagram illustrating an operation flow of the stream control unit 13. In this figure, the stream control unit 13 first determines whether or not there is a stream output start command (step S31). If there is a stream output start command, the head of the GOP of the moving picture stream sent from the FIFO memory 9 is searched (step S32), and GOP (Group of Pictures: the minimum processing unit in the compression codec). The operation of transferring the stream to the recording media control unit 14 in order from the head portion of (No. S33) is repeated.

  On the other hand, if there is no stream output start command, it is next determined whether or not there is a stream output pause command (step S34). If there is no stream output pause command, the flow returns to step S31 again to return to the stream output pause command. If there is, the head of the GOP of the moving image stream sent from the FIFO memory 9 is searched (step S35), and the stream is sent to the recording media control unit 14 until just before the head of the GOP (the last of the previous GOP). After the transfer, the operation of temporarily stopping the transfer (step S33) is repeated.

  By executing the operation flow as described above (FIGS. 3, 4 and 7), it is possible to create a digest video stream separately in parallel with the generation of the normal video stream. Can be recorded information (association data table 20 and digest version moving image index management table 21) that associates the digest version moving image stream and still image with each other.

<Reproduction processing>
Next, playback processing of the normal moving picture stream, digest version moving picture stream and still picture data recorded as described above will be described.

First, an example of information stored in the association data table 20 used in the reproduction process is shown.
FIG. 8 is a diagram showing an example of storage information of the association data table 20 used in the reproduction process. “Normal video file A” is stored as the normal video file name in the normal video file name field 20a, and the digest version video is stored. “Digest version video file A” is stored as the digest version video file name in the file name field 20b, and “still picture file A” and “still picture file B” are used as the still picture file name in the still picture file name field 20c. ”And“ still image file C ”are stored, and“ 0:01:00 ”and“ 0:05:00 ”are stored in the normal moving image elapsed time field 20d as information for defining the mutual relationship between these files. , “0: 09: 0”, “0:10:00” normal movie elapsed time information and digest version "Index X" in the index information field 20e, "index Y", and the digest video index information "index Z" are stored.

  FIG. 9 is a diagram illustrating an operation flow during reproduction in the central control unit 7. When this operation flow is started, first, a representative image (generally a thumbnail image) of each image file is displayed on the display unit 5 (step S41). Here, each image data means a normal image, a digest version moving image, and a still image that are associated (associated) with each other by the association data table 20.

  Next, the image file selection operation by the user is determined (step S42), and if selected, the selected image and all image options associated with the selected image are displayed (step S43). For example, if the selected image is a “still image” and “normal video” and “digest video” are associated with the still image, those images (still image, normal video, digest video) A selection object (for example, an icon, a menu, or the like) is displayed for selecting and reproducing any of these.

  Then, selection input of image data to be reproduced first is detected (step S44), and reproduction processing corresponding to the type of the detected image data, that is, normal moving image data reproduction processing (step S45), digest version moving image data reproduction. Either the process (step S46) or the still image data reproduction process (step S47) is executed.

Here, the display of “option” in step S43 will be described with an example.
FIG. 10 is a diagram showing an option display screen. In this figure, the display screen 5 a of the display unit 5 is provided with a plurality (here, five) of rectangular display areas 22 to 26. The display areas 22 to 26 are objects for displaying representative images of the images associated with each other by the association data table 20, and in the illustrated example, the representative image 22a of the normal moving image file A is displayed in the upper left display area 22. Is displayed, the representative image 23a of the digest version video file A is displayed in the upper right display area 23, the representative image 24a of the still image file A is displayed in the lower left display area 24, and the still image is displayed in the lower center display area 25. The representative image 25a of the file B is displayed, and the representative image 26a of the still image file C is displayed in the display area 26 at the lower right.

  Further, in each of the display areas 22 to 26, an icon indicating the presence of another image associated with each representative image is displayed. For example, a digest icon 22b and a still image icon 22c are displayed in the upper left corner of the display area 22, and a normal moving image icon 23b and a still image icon 23c are displayed in the upper left corner of the display area 23. A digest icon 24b and a normal moving image icon 24c are displayed in the upper left corner of the display area, a digest icon 25b and a normal moving image icon 25c are displayed in the upper left corner of the display area 25, and a digest is displayed in the upper left corner of the display area 26. An icon 25b is displayed.

  Therefore, by simply glancing at these icons, it is possible to know that the digest movie and the still image are associated with the normal movie file A, and the regular movie and the still image are associated with the digest file A. That the still image file A is associated with the digest version video and the normal video, and the still image file B is the digest version video and the normal video. Can be known, and the still image file C can be known to be associated with the digest version moving image.

  In addition, by selecting one of the display areas 22 to 26, the following “option” object for selectively reproducing the associated image can be displayed.

  FIG. 11 is a diagram showing a choice object (part 1). In this figure, for example, if the upper left display area 22 is selected (indicated by a thick frame and hatching), in this case, the normal moving image file A in the display area 22 and the normal moving image file A are associated with each other. A selection object menu 27 for selecting either the digest version moving image file or the still image file is displayed. The choice object menu 27 has three choices of “play this normal movie”, “play a related digest movie”, and “play a slide show of related still images”. The normal moving image file A in the display area 22 and either the digest version moving image file or the still image file associated with the normal moving image file A can be reproduced.

  FIG. 12 is a diagram illustrating a choice object (part 2). In this figure, for example, if the upper right display area 23 is selected (indicated by a thick frame and hatching), in this case, the digest version video file A and the digest version video file A in the display area 23 are displayed. An option object menu 28 for selecting either the associated normal moving image file or still image file is displayed. The option object menu 28 has three options of “play this digest video”, “play related normal video”, and “slide related still images”, and by selecting one of the options The digest version moving image file A in the display area 23 and either the normal moving image file or the still image file associated with the digest version moving image file A can be reproduced.

  FIG. 13 is a diagram illustrating a choice object (part 3). In this figure, for example, if the lower left display area 24 is selected (indicated by a thick frame and hatching), in this case, the still image file A in the display area 24 and the still image file A are associated with each other. An option object menu 29 for selecting either the digest version moving image file or the normal moving image file is displayed. The option object menu 29 has three options of “slide show from this still image file”, “play related normal video”, and “play related digest video”, and select one of the options. Thus, either the still image file A in the display area 24, the digest version moving image file associated with the still image file A, or the normal moving image file can be reproduced.

  FIG. 14 is a diagram illustrating a choice object (part 4). In this figure, for example, if the lower right display area 26 is selected (indicated by a thick frame and hatching), in this case, the still image file C in the display area 26 and the still image file C are associated with each other. An option object menu 30 for selecting any one of the digest video files is displayed. The option object menu 30 has three options of “slide show from this still image file”, “play back related normal video”, and “play back related digest video”. However, options that are not associated (here, “reproduce related normal moving images”) are in a non-selectable state (light color display state). By selecting one of the options other than “play related normal movie”, either the still image file C in the display area 26 or the digest version movie file associated with the still image file C is played. Can be done.

  As described above, when starting the reproduction process, the central control unit 7 first searches the moving image stream and still image data stored in the recording medium 15 and refers to the association data table 20. The central control unit 7 performs display as shown in FIG. 10 on the display unit 5 based on these pieces of information. FIG. 10 shows a list of files stored in the recording medium 15 and whether there is a file associated with each file. The contents of the stored information in the association data table 20 in FIG. It is reflected. That is, since the normal moving image file A, the digest version moving image file A, and the still image files A, B, and C are associated with each other in the association data table 20 of FIG. 8, the display is as shown in FIG.

  Further, according to FIG. 8, the still image files A and B are associated with both the normal movie file A and the digest version movie file A (see indexes X and Z), but the still image file C is associated. Since there is no digest version movie file (no index), such a display is shown in FIG. Such a state may occur when the digest version moving image generation permission key in the description of FIGS. 3 and 4 is in a “prohibited” state.

  The central control unit 7 waits for a reproduction instruction from the user when the display of FIG. 10 is performed. When the user selects a file to be reproduced with a cursor key (not shown) and presses an enter key (not shown), for example, a display as shown in FIG. 11 is displayed. FIG. 11 shows an example when the normal moving image file A is selected. The normal moving image file A is reproduced, the related digest version moving image file A is reproduced, or the related still image files A, B, A display for allowing the user to select whether or not to play C as a slide show is displayed.

  The user selects a desired reproduction operation using the cursor key and the enter key. When the user selects an operation, the central control unit 7 performs the normal moving image playback state process (step S45 in FIG. 9) if normal video playback is selected, and the digest version if digest video playback is selected. The moving image playback state process (step S46 in FIG. 9) is performed, and if still image file playback is selected, the still image playback state process (step S47 in FIG. 9: still image slide show playback in this embodiment) is performed.

  Similarly, when the digest version moving image file A is selected on the screen of FIG. 10, the display is as shown in FIG. Alternatively, when still image files A and B are selected in FIG. 10, the display is as shown in FIG. Further, when the still image file C is selected, there is no related digest version moving image file, so the display is as shown in FIG.

  FIG. 12 shows a screen for selecting whether to play the selected digest movie file, to play the related normal movie file, or to play a slide show of the related still image file. FIGS. 4 shows a screen for selecting whether to start slide show playback from a still image file, to play back a related normal moving image file, or to play back a related digest version moving image file.

  As described above, playback for each type of image (normal video, digest version video, still image) is started. For example, during normal video playback, switching to related still image playback, or , A mechanism for switching to the playback of the digest version video is necessary. That is, a flexible playback switching mechanism is required between a normal moving image, a still image, and a digest version moving image.

  FIG. 15 is a state transition diagram showing a mechanism for switching playback destinations. In this figure, three circular figures respectively indicate a normal moving image reproduction state S100, a still image reproduction state S101, and a digest moving image reproduction state S102, and arrow lines (R1 to R6) connecting these states are state transition condition lines. Indicates. Here, R1 is a state transition condition line “near the time in the association data table 20 and there is a request from the user to switch from normal movie playback to still image playback”, and R2 is “still image playback from the user” Is a state transition condition line of “There is a request to switch to normal video playback”. Further, R3 is a state transition condition line that “the user has requested to switch from still image playback to digest video playback and the digest video with the latest operating condition at the transition destination” is played, and R4 is “association data” This is a state transition condition line that indicates that there is a switch request from the digest video playback to the still image playback near the time in the table 20. Also, R5 is a state transition condition line that “user has requested to switch from digest video playback to normal video playback”, and R6 is “user has requested to switch from normal video playback to digest video playback, and This is a state transition condition line that “plays back the digest video with the latest operating condition at the transition destination”.

  FIG. 16 is a diagram showing display screen examples in three playback states (normal video playback state S100, still image playback state S101, and digest video playback state S102). In this figure, (a) to (c) are display screen examples in the normal moving image playback state S100, (d) and (e) are display screen examples in the still image playback state S101, and (f), (g ) Is an example of a display screen in the digest video playback state S102.

  First, during normal video playback, as shown in FIG. 16A, normal video playback is displayed in the display area 31 slightly smaller than the entire screen 5a, and the elapsed time from the top of the normal video file of the scene being played back is displayed. Keep monitoring. Then, referring to the elapsed time and the information in the association data table 20, when the time recorded in the association data table 20 is reached, the display shifts to a display as shown in FIG. FIG. 16B is a display example in the case of “0:01:00” in FIG. 8, for example, and displays a digest video icon 32 and a still image icon 33 that can be selected, and a digest video. The user can be switched to the still image file. When the user selects a desired reproduction with the cursor key and the enter key at the timing when the display of FIG. 16B is displayed (selects either the digest video icon 32 or the still image icon 33), the reproduction is switched. Become. Further, since there is no associated still image file at “0:05:00” in FIG. 8, the display is as shown in FIG. 16C. In this display example, the still image icon 33 cannot be selected. It is in a state (light color display).

  FIG. 17 is a diagram showing a detailed operation flow of still image data reproduction (step S47 in FIG. 9). As shown in this operation flow, in the still image data reproduction, first, it is determined whether or not the normal moving image data was reproduced immediately before (step S51). The reproduction time when the selection input is made is detected (step S52). Next, a slide show is displayed from still image data closest to the future side of the detected reproduction time (step S53), and an option of “normal moving image” is displayed (step S57).

  On the other hand, if it is not determined in step S51 that the normal moving image data was reproduced immediately before, it is next determined whether or not the digest moving image data was reproduced immediately before (step S54). If it is being played back, a slide show is displayed from the still image data associated with the digest video data that was played back immediately before (step S55). If not being played back, the slide show is started from still image data with the first index. Is displayed (step S56), and in either case, the option of “normal moving image” is displayed (step S57).

  Next, it is determined whether or not there is a digest video associated with the still image data currently being played back (step S58), and the “digest” option is displayed only if there is (step S59). Next, the selection input of “normal video” is detected (step S60). When the selection input of “normal video” is detected, normal video data reproduction (step S45 in FIG. 9) is executed. When the selection input of “digest video” is detected (step S61) and the selection input of “digest video” is detected, digest video data reproduction (step S46 in FIG. 9) is executed. The process returns to step S57.

  FIG. 18 is a diagram showing a detailed operation flow of digest moving image data reproduction (step S46 in FIG. 9). As shown in this operation flow, in digest video data playback, first, it is determined whether or not normal video data has been played back immediately before (step S71). The reproduction time when the selection input is made is detected (step S72). Next, the digest movie closest to the future of the detected playback time is reproduced and displayed (step S73), and the option of “normal movie” is displayed (step S77).

  On the other hand, if it is not determined in step S71 that the normal moving image data was reproduced immediately before, it is next determined whether or not the still image data was reproduced immediately before (step S74). If it is being played back, the digest video data associated with the still picture data played back immediately before is played back and displayed (step S75), and if not played back, the digest video with the first index is played back and displayed. (Step S76) In both cases, the option of “normal moving image” is displayed (Step S77).

  Next, “present” of the still image data associated with the digest video data currently being reproduced is determined (step S78), and the option of “still image” is displayed only when there is (step S79). Next, the selection input of “normal video” is detected (step S80), and when the selection input of “normal video” is detected, normal video data reproduction (step S45 in FIG. 9) is executed. When the selection input of “still image” is detected (step S81), and the selection input of “still image” is detected, the reproduction of still image data (step S47 in FIG. 9) is executed. The process returns to step S77.

  FIG. 19 is a diagram showing a detailed operation flow of normal moving image data reproduction (step S45 in FIG. 9). As shown in this operation flow, in normal video data playback, first, it is determined whether or not digest video or still image data was played back immediately before (step S91). The reproduction time indicated by the index of the image data (digest moving image or still image data) reproduced in step S92 is detected (step S92). Next, the normal movie is reproduced and displayed from the detected reproduction time (step S93), and the option of “digest movie” is displayed (step S95).

  On the other hand, if it is not determined in step S91 that the digest video or still image data was played back immediately before, the normal video data is played back and displayed from the first playback time (0:00:00). (Step S94), “Digest video” options are displayed (Step S95).

  Next, it is determined whether or not the current playback time is within 10 seconds of the playback time indicated by the most recent index (step S96), and the option of “still image” is displayed only within the time (step S97). . Next, the selection input of “digest video” is detected (step S98), and when the selection input of “digest video” is detected, digest video data reproduction (step S46 in FIG. 9) is executed. When the selection input of “still image” is detected (step S99), and the selection input of “still image” is detected, the reproduction of still image data (step S47 in FIG. 9) is executed. The process returns to step S95.

  By the way, during normal video playback, regardless of whether or not the time is recorded in the association data table 20, a display that always allows selection of digest version video playback, that is, a display as shown in FIG. It is desirable to do. Similarly, in “0:10:00” of FIG. 8, there is no index information of the associated digest version moving image, but even in this case, it is desirable to perform the display as shown in FIG. FIG. 16C is a display example when only the digest version moving image is associated with the normal moving image being reproduced (that is, when no still image is associated).

  In this way, when the user selects a digest version video when there is no associated digest version video, the index information of the digest version video and the elapsed time are referred to, and the future time is longer than the elapsed time. In addition, the digest version of the movie may be played from the nearest index information. In this way, when a boring scene continues during normal video playback and the user gets tired of watching it, the user can immediately switch to the digest version of the video, improving usability.

  In the above description, the timing for performing the display in FIGS. 16B and 16C is the time when the elapsed time is the time recorded in the association data table 20, but the present invention is not limited to this. Instead, for example, the display of FIG. 16B and FIG. 16C may be continued for 10 seconds before and after the time recorded in the association data table 20. In this way, for example, when the display time of FIGS. 16B and 16C is too short, it is possible to avoid the inconvenience that the user's operation is not in time.

  This is the description of the transition from the normal moving image reproduction state S100 of FIG. 15 to the still image reproduction state S101 and the digest version moving image reproduction state S102. Similarly, the transition from the still image reproduction state S101 will be described. The transition from the still image playback state S101 to the normal moving image playback state S100 can always be made if there is a playback switching request from the user. On the other hand, the transition from the still image reproduction state S101 to the digest version moving image reproduction state S102 can always be changed in response to a request from the user in FIG. However, as can be seen from FIG. 8, depending on the still image, there may be no index information of the associated digest movie. For example, the still image file C is applicable.

  In such a case, that is, when a still image slide show is being performed in the still image reproduction state S101 and the still image file C is being reproduced, and the user requests switching to the digest version video. Acquires the time information of the still image file C from the association data table 20, and reproduces the digest version moving image at a future time and closest index information from the time information.

  FIG. 16D shows an example of display in the still image playback state. The example in which the transition from the still image playback state S101 to the digest version movie playback state S102 is always possible has been described above. However, when there is no digest version movie index information associated with the still image file, the digest version A method of making the transition to video playback impossible is also conceivable. A display example in this case is shown in FIG. FIG. 16E is a display example when a still image file without index information of the associated digest version moving image is being reproduced.

  The display of FIG. 16 (d) and FIG. 16 (e) may be switched depending on whether or not the still image file being reproduced in the slide show has the associated digest version moving image index information.

  Next, the transition from the digest version moving image playback state S102 will be described. Transition from the digest version video playback state S102 to the normal video playback state S101 is always possible if there is a switching request from the user. Switching from the digest version moving image playback state S102 to the still image playback state S101 can be transitioned when there is a still image associated with the association data table 20 of FIG. In the example of FIG. 8, if the digest version moving image index X is being reproduced, the transition to the reproduction of the still image file A can be performed. However, when the index Y is being reproduced, there is no associated still image file, and transition is not possible. Further, during playback of the index Z, it is possible to transition to playback of the still image file B.

  By the way, there is a concern that the still image file C cannot be directly transferred to the still image file C during the digest version moving image reproduction. There is no problem because the still image file C is displayed as one scene in the slide show. FIG. 16 (f) and FIG. 16 (g) show display examples during digest video reproduction. If still image file playback is not performed as a slide show, the index data Z of the digest version movie is being played back while referring to the association data table 20 and the time close to the scene of the digest movie currently being played back is referred to. What is necessary is just to reproduce a still image file.

As described above, according to the present embodiment, during normal video data playback, the playback target can be switched to digest version video data or still image data. All the image data associated with the moving image data can be viewed while viewing.
In addition, according to the present embodiment, normal video playback, digest video playback, and still image playback can be freely switched using the association data table 20, and a new viewing style can be provided to the user.

  In addition, since related information of a plurality of different types of image data is displayed by option objects (option object menus 27, 28, 29, and 30), the user is allowed to select them. The presence or absence of the associated image data can be intuitively known, and the operability can be improved.

  In the above description, the association information of each image is stored in the association data table 20, and the table 20 is stored in the recording medium 15. However, the present invention is not limited to this, and the association information may be a normal movie stream or a digest movie. You may make it record on each header of a stream and still picture data.

  In the above description, the association data table 20 holds only information for associating the normal moving image file A, the digest version moving image file A, and the still image file, but this is merely for convenience of explanation. Of course, when there are a plurality of normal moving image files and digest version moving image files, the number of association data tables 20 increases as a matter of course. At this time, the number of files displayed in FIG. 10 also increases.

  Furthermore, in the above description, the digest version movie is an independent file. However, the present invention is not limited to this. For example, from the file name of the original normal movie and the cut-out information (frame number, etc.) from the normal movie. You may comprise with the following link information. In this way, the link information is simply text information, and the amount of information is much smaller than that of the digest version moving image, which is preferable since the capacity of the recording medium 15 is not reduced.

It is a figure which shows the structure of three types of images used by embodiment. It is a block diagram of the imaging device concerning this embodiment. It is a figure (1/2) which shows the operation | movement flow of the central control part 7. FIG. It is a figure (2/2) which shows the operation | movement flow of the central control part 7. FIG. 3 is a conceptual structural diagram of an association data table 20. FIG. 3 is a conceptual structural diagram of a digest version moving image index management table 21. FIG. 6 is a diagram illustrating an operation flow of a stream control unit 13. FIG. It is a figure which shows an example of the storage information of the correlation data table 20 used by a reproduction | regeneration process. It is a figure which shows the operation | movement flow at the time of reproduction | regeneration in the central control part. It is a figure which shows the display screen of an option. It is a figure which shows the choice object (the 1). It is a figure which shows the choice object (the 2). It is a figure which shows the choice object (the 3). It is a figure which shows the choice object (the 4). It is a state transition diagram which shows the mechanism of switching of reproduction | regeneration destination. It is a figure which shows the example of a display screen in three reproduction | regeneration states (normal moving image reproduction state S100, still image reproduction state S101, and digest moving image reproduction state S102). It is a figure which shows the detailed operation | movement flow of still image data reproduction | regeneration (step S47 of FIG. 9). It is a figure which shows the detailed operation | movement flow of digest moving image data reproduction | regeneration (step S46 of FIG. 9). It is a figure which shows the detailed operation | movement flow of normal moving image data reproduction | regeneration (step S45 of FIG. 9).

Explanation of symbols

1 Shooting device (image playback device)
5 Display section (display means)
7 Central control unit (selection means, display control means)
15 Recording media (recording means)

Claims (4)

The first moving image data having a first reproduction time, the second moving image data having a second reproduction time shorter than the first reproduction time, and still image data, which are associated with each other, are recorded. Recording means;
In an image reproduction device comprising display means for displaying the image data,
Others associated with the currently displayed image data when any one of the first moving image data, the second moving image data, and the still image data is displayed on the display means Selecting means for selecting the image data;
Display control means for displaying other image data selected by the selection means on the display means;
Equipped with a,
In the recording means, a plurality of time indexes respectively indicating different reproduction times in the first moving image data are recorded,
The second moving image data is
A plurality of moving image data for the second reproduction time before and after each reproduction time indicated by the plurality of time indexes in the first moving image data,
The still image data is
A plurality of still image data at each reproduction time indicated by the time index, which constitutes the first moving image data;
An image reproducing apparatus characterized by that. The selection means includes
When the first moving image data is displayed on the display means, the second moving image data or the still image data associated with the first moving image data is selected,
When the second moving image data is displayed on the display means, the first moving image data or the still image data associated with the second moving image data is selected,
When the still image data is displayed on the display means, the first moving image data or the first moving image data associated with the first moving image data is selected.
The image reproducing apparatus according to claim 1, wherein: The selection means includes
When any type of image data among the first moving image data, the second moving image data, and the still image data is displayed on the display means, and another type of image data is selected The image data to be displayed can be mutually selected from other types of image data based on the time information of the currently displayed image data,
The display control means includes
The image data selected by the selection means is displayed in the order of the time indicated by the time index.
The image reproducing apparatus according to claim 1, wherein the image reproducing apparatus is an image reproducing apparatus. The first moving image data having the first reproduction time, the second moving image data having the second reproduction time shorter than the first reproduction time, and the still image data image data are associated with each other. Recorded recording means;
A computer comprising display means for displaying the image data;
Others associated with the currently displayed image data when any one of the first moving image data, the second moving image data, and the still image data is displayed on the display means Selection means for selecting image data of
The other image data selected by the selection means is caused to function as a display control means for displaying on the display means ,
In the recording means, a plurality of time indexes respectively indicating different reproduction times in the first moving image data are recorded,
The second moving image data is
A plurality of moving image data for the second reproduction time before and after each reproduction time indicated by the plurality of time indexes in the first moving image data,
The still image data is
A plurality of still image data at each reproduction time indicated by the time index, which constitutes the first moving image data;
A program characterized by that.

Images