JP2007110467A - Image recording reproducing device, display method of image data, and image data displaying method of thumbnail image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a displaying method of thumbnail image data capable of recognizing the reproduction status of each moving video data. <P>SOLUTION: In an image recording reproducing device used in a thumbnail image data display method for displaying a plurality of thumbnail image data in a screen; a plurality of image data are extracted from input moving video data, and the plurality of thumbnail image data are generated corresponding to each of plurality of extracted image data. As the thumbnail image data corresponding to the input moving video data subjected to a reproduction process, a still image is displayed, and as the thumbnail image data corresponding to the input moving video data not subjected to the reproduction process, a moving video is displayed. <P>COPYRIGHT: (C)2007,JPO&INPIT

Description

  The present invention relates to an image recording / playback apparatus used in a thumbnail image data display method for displaying a plurality of thumbnail image data in a screen, a display method for image data, and a thumbnail image data display for displaying a plurality of thumbnail image data in a screen. It is about the method.

  In daily life, television broadcasts may be recorded and recorded with a hard disk recorder or video cassette recorder, or the photographer's foreground scene may be recorded and recorded with a movie shooting function of a digital movie or digital still camera. In these cases, as a method for easily confirming the recorded contents without actually reproducing a plurality of recorded moving image data, as in the confirmation of still image data taken with a digital still camera, In many cases, a thumbnail display that displays a plurality of still image data generated by reducing the frame extracted from the image on the screen is used.

  For example, the following patent document proposes a method of extracting a plurality of still image data from moving image data, generating a plurality of thumbnail image data, and displaying the frame advance.

JP-A-11-284948

  However, in the conventional display method described above, moving image data is displayed without distinction between moving image data that has not yet been reproduced, moving image data that is being reproduced, or reproduced moving image data, and the user can reproduce which moving image data. I couldn't confirm whether

  The present invention has been made in view of the above problems, and it is an object of the present invention to provide an image recording / reproducing apparatus capable of distinguishing reproduction states for a plurality of moving image data.

An image recording / reproducing apparatus according to the present invention includes:
An image recording / reproducing apparatus used in a thumbnail image data display method for displaying a plurality of thumbnail image data on a screen,
An image data processing unit for encoding input moving image data;
Extracting a plurality of image data from the input moving image data and outputting the plurality of thumbnail image data corresponding to each of the extracted plurality of image data;
The encoded image data subjected to the encoding process, and an image data recording unit for recording the plurality of thumbnail image data;
An image data reproduction unit that reproduces the encoded image data;
The thumbnail image data processing unit outputs image data at the time when the reproduction process is stopped, or thumbnail still image data corresponding to image data that is temporally close to the image data,
The thumbnail moving image data is output as the thumbnail image data corresponding to the image data not subjected to the reproduction process.

  According to the image recording / playback apparatus of the present invention, by checking the thumbnail image data, it is possible to distinguish the playback state whether or not the playback processing has been performed on the moving image data corresponding to the thumbnail image data. Become.

Embodiment 1 FIG.
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings. In addition, as a moving image encoding method in the following description, ITU-T (International Telecommunication Union-Telecommunication sector) recommendation H.264 is recommended. 26x, ISO / IEC (International Organization for Standardization / International Electrotechnical Commission), and MPEG (Moving Picture Experts Group).

<Configuration of image recording / playback apparatus>
FIG. 1 is a block diagram schematically showing a configuration of an image recording / reproducing apparatus 101 according to Embodiment 1 of the present invention. As shown in FIG. 1, an image recording / reproducing apparatus 101 includes an operation unit 1, a control unit 2, input terminals 3a and 3b, an image data processing unit 4, an image data recording unit 5, and a thumbnail image data processing unit. 6 and an image data reproduction unit 7. In the figure, the display unit 8 is not a component of the image recording / reproducing apparatus 101, but the image recording / reproducing apparatus 101 including the display unit 8 may be used.

  The image data processing unit 4 includes a moving image data encoding unit 41. The thumbnail image data processing unit 5 includes a representative image data extraction unit 61, a thumbnail image data generation unit 62, a thumbnail image data management unit 63, and a thumbnail image data reproduction unit 64. The image data reproducing unit 7 includes a moving image data decoding unit 71.

  The operation unit 1 includes various buttons and keys, and an operator (user) operates the buttons and keys to output commands such as recording start / stop, reproduction start / stop, and display switching to the control unit 2. To do. The control unit 2 controls the image data processing unit 4, the thumbnail image data processing unit 6, and the image data reproduction unit 7 in accordance with instructions from the operation unit 1. The display unit 8 may also be controlled by the control unit 2.

  The image data processing unit 4 encodes the moving image data input from the input terminal 3 a in the internal moving image data encoding unit 41, and outputs the encoded image data to the image data recording unit 5.

  The thumbnail image data processing unit 6 extracts representative image data from the input moving image data based on the moving image data input from the input terminal 3a and the audio data input from the input terminal 3b. Further, thumbnail image data of the representative image data is generated. Then, moving image encoding such as MPEG2 and MPEG4 or still image encoding such as JPEG is performed to generate encoded data of thumbnail image data (hereinafter also referred to as “encoded thumbnail image data”), and the image data. Output to the recording unit 5.

  The thumbnail image data processing unit 6 decodes the encoded thumbnail image data output from the image data recording unit 5 to generate thumbnail image data, and outputs the thumbnail image data to the display unit 8.

  The image data recording unit 5 records the encoded image data output from the image data processing unit 4 and the encoded thumbnail image data generated by the thumbnail image data processing unit 6. The image data reproducing unit 7 decodes the encoded image data output from the image data recording unit 5 by the internal moving image data decoding unit 71, and outputs the decoded moving image data to the display unit 8. . The display unit 8 selects, synthesizes and displays the moving image data output from the image data reproducing unit 7 and the thumbnail image data output from the thumbnail image data processing unit 6.

<Representative image data extraction unit>
Further, each component will be described in detail. FIG. 2 is a block diagram schematically showing the configuration of the representative image data extraction unit 61 in the thumbnail image data processing unit 6 shown in FIG. As shown in FIG. 2, the representative image data extraction unit 61 includes input terminals 601, 602, and 605, a scene change detection unit 603, a sound volume change detection unit 604, a representative image data determination unit 606, a switch 607, and an output terminal 608. It has.

  The moving image data input from the input terminal 3a is input to the input terminal 601. The audio data input from the input terminal 3b is input to the input terminal 602. A control signal such as a sampling period and a sampling period of the representative image data from the operation unit 2 is input to the input terminal 605.

  The scene change detection unit 603 detects a change in the screen content for each frame of the moving image data input from the input terminal 601 (for each video object plane (VOP in the case of MPEG4)), and detects the detection signal (hereinafter, “scene” The change detection signal ”is also output to the representative image data determination unit 606.

  The volume sound quality change detection unit 604 detects a time change related to sound, such as the volume and sound quality of the audio data input from the input terminal 602, and a detection signal (hereinafter also referred to as “volume sound quality change detection signal”). The data is output to the representative image data determination unit 606.

  The representative image data determination unit 606 receives the scene change detection signal output from the scene change detection unit 603, the volume sound quality change detection signal output from the volume sound quality change detection unit 604, and the sampling input via the input terminal 605. Based on the control signals such as the period and the sampling period, the actual sampling timing in the switch 607 is determined.

  The switch 607 samples the moving image data input from the input terminal 601 by turning it ON / OFF at the sampling timing output from the representative image data determination unit 606. The output terminal 608 outputs the moving image data sampled by the switch 607.

<Thumbnail image data generator>
FIG. 3 is a block diagram schematically showing the configuration of the thumbnail image data generation unit 62 shown in FIG. As shown in FIG. 3, the thumbnail image data generation unit 62 includes input terminals 621, 622, 623, a switch 624, a resizing unit 625, a thumbnail image data encoding unit 626, and an output terminal 627.

  The moving image data output from the output terminal 608 is input to the input terminal 621. Moving image data decoded and output by the image data reproducing unit 7 (hereinafter also referred to as “reproduced image data”) is input to the input terminal 622. In particular, one frame of still image data when reproduction is stopped is referred to as “reproduction stopped image data”. Is also entered). A thumbnail generation input switching signal from the control unit 2 is input to the input terminal 623. The switch 624 switches between moving image data input from the input terminal 621 and reproduced image data input from the input terminal 622 based on a thumbnail generation input switching signal input via the input terminal 623.

  The resizing unit 625 performs resizing processing on the image data selected by the switch 624, and generates thumbnail image data.

  The thumbnail image data encoding unit 626 performs encoding of moving images such as MPEG2 and MPEG4 or still image encoding such as JPEG on the thumbnail image data obtained by the resizing unit 625 to generate encoded thumbnail image data. To do.

  The output terminal 627 outputs the encoded thumbnail image data generated from the thumbnail image data encoding unit 626.

<Thumbnail image data management unit>
FIG. 4 is a block diagram schematically showing the configuration of the thumbnail image data management unit 63 shown in FIG. As shown in FIG. 4, the thumbnail image data management unit 63 includes input terminals 631, 639a, 639b, input / output terminals 636a, 636b, 636c, switches 632, 637, thumbnail representative moving image data management unit 633, thumbnail representative still image. An image data management unit 634 and a thumbnail reproduction stop image data management unit 635 are provided.

  Encoded thumbnail image data generated by the thumbnail image data generation unit 62 is input to the input terminal 631. The thumbnail distribution signal input from the control unit 2 is input to the input terminal 639a, and the switch 632 is switched. The switch 632 converts the encoded thumbnail image data input from the input terminal 631 into the thumbnail representative moving image data management unit 633, the thumbnail representative still image data management unit 634, and the thumbnail by the thumbnail distribution signal input from the input terminal 639a. This is distributed to the reproduction stop image data management unit 635.

  The thumbnail representative moving image data management unit 633 receives encoded thumbnail image data of a plurality of moving image data input to the thumbnail image data generating unit 62 and processed through the input terminal 621. Then, the thumbnail representative moving image data management unit 633 manages the encoded thumbnail image data and the control data including the time information. Here, the time information includes the time at the time of recording (absolute time), the time from the start of recording (relative time), and the like.

  The thumbnail representative still image data management unit 634 receives encoded thumbnail image data of one piece of still image data representing moving image data, and manages control data including the time information.

  The thumbnail reproduction stop image data management unit 635 receives the encoded thumbnail image data of one piece of reproduction stop image data that has been input to the thumbnail image data generation unit 62 through the input terminal 622 and encoded. Manage control data including information.

  The input / output terminal 636 a exchanges encoded thumbnail image data managed by the thumbnail representative moving image data management unit 633 with the image data recording unit 5. The input / output terminal 636 b exchanges the encoded thumbnail image data managed by the thumbnail representative still image data management unit 634 with the image data recording unit 5. The input / output terminal 636 c exchanges the encoded thumbnail image data managed by the thumbnail reproduction stop image data management unit 635 with the image data recording unit 5.

  A thumbnail selection signal input from the control unit 2 is input to the input terminal 639b, and the switch 637 is switched. In the switch 637, the encoded thumbnail image output from the thumbnail representative moving image data management unit 633, the thumbnail representative still image data management unit 634, and the thumbnail reproduction stop image data management unit 635 according to the thumbnail selection signal input from the input terminal 639 b. The data is switched and output to the output terminal 638. The output terminal 638 outputs the encoded thumbnail image data selected by the switch 637.

<Thumbnail image data playback section>
FIG. 5 is a block diagram schematically showing the configuration of the thumbnail image data reproducing unit 64 shown in FIG. As shown in FIG. 5, the thumbnail image data reproducing unit 64 includes an input terminal 641, a thumbnail image data decoding unit 642, and an output terminal 643.

  Encoded thumbnail image data output from the thumbnail image data management unit 63 is input to the input terminal 641. The thumbnail image decoding unit 642 decodes the encoded thumbnail image data input from the input terminal 641 to generate thumbnail image data. The output terminal 643 outputs thumbnail image data obtained by decoding by the thumbnail image data decoding unit 642.

<Operation of Image Recording / Reproducing Device>
The operation of the image recording / reproducing apparatus 101 according to Embodiment 1 will be described below with reference to FIGS. As shown in FIG. 1, an operator (user) outputs an operation command to the control unit 2 by operating a button or key of the operation unit 1. The control unit 2 controls the image data processing unit 4, the thumbnail image data processing unit 6, and the image data reproduction unit 7 according to an operation command from the operation unit 1. The display unit 8 may be included as a control target of the control unit 2.

  Specifically, the image data processing unit 4, the thumbnail image data processing unit 6, and the display unit 8 are controlled during recording, and the thumbnail image data processing unit 6, the image data reproduction unit 7, and the display unit 8 are controlled during reproduction. It will be.

<Operation during recording of image recording / playback apparatus>
First, the recording operation of the image recording / reproducing apparatus 101 according to the first embodiment will be described. The moving image data is input to the image data processing unit 4 and the thumbnail image data processing unit 6 through the input terminal 3a. The audio data is input to the thumbnail image data processing unit 6 via the input terminal 3b. The moving image data input to the image data processing unit 4 via the input terminal 3a is converted into MPEG2, MPEG4, H.264 by an internal moving image data encoding unit 41. It is encoded by a moving image encoding method such as H.264. The encoded image data obtained by encoding is output to the image data recording unit 5, where it is recorded and stored.

  The moving image data input to the thumbnail image data processing unit 6 through the input terminal 3 a is input to the scene change detection unit 603 and the terminal a of the switch 607 through the input terminal 601. On the other hand, the audio data input to the thumbnail image data processing unit 6 via the input terminal 3 b is input to the volume sound quality change detection unit 604 via the input terminal 602.

  The scene change detection unit 603 detects a scene change from the moving image data input from the input terminal 601 and outputs a scene change detection signal to the representative image data determination unit 606. As an example of scene change detection, a difference between frames is calculated for each pixel constituting a frame, an absolute sum of the differences is calculated, and it is determined that a scene change has occurred when the absolute sum exceeds a certain threshold. The scene change detection method is not limited to this. Processing may be performed in the field, or after dividing a frame into blocks, an absolute sum of differences may be calculated for each block, and a scene change may be determined based on the number of blocks exceeding the threshold.

  The volume / sound quality change detection unit 604 detects the volume, sound quality, and temporal changes of the audio data input via the input terminal 602, and outputs a volume / sound quality change detection signal to the representative image determination unit 606. Specifically, stereo / monaural switching, a silent period, and the like are detected. Also included are changes in volume.

  From the input terminal 605, control signals such as a sampling period and a sampling period for extracting representative image data are input from the control unit 2 and input to the representative image data determination unit 606. In the representative image data determination unit 606, the scene change detection signal output from the scene change detection unit 603, the volume sound quality change detection signal output from the volume sound quality change detection unit 604, and the sampling period of the representative image input from the input terminal 605 The sampling timing is set based on the control signal such as the sampling period, and the sampling signal is output to the switch 607.

  Moving image data is input to the terminal a of the switch 607 via the input terminal 601. In the switch 607, the terminal a and the terminal b are turned ON / OFF by a sampling signal from the representative image data determination unit 606, so that the moving image data input to the terminal a via the input terminal 601 is transferred to the terminal b. Control the output of. Specifically, representative image data of moving image data input from the input terminal 601 is determined, and representative image data is extracted.

  Sampled image data output from the terminal b of the switch 607 (hereinafter, each image is expressed as “representative image data”, and a series of image data constituted by the representative image data is represented by “representative moving image data”. , One specific piece of the representative moving image data is also referred to as “representative still image data”.) Is output via the output terminal 608.

  The representative moving image data output from the terminal 608 of the representative image data extraction unit 61 is input to the thumbnail image data generation unit 62 via the input terminal 621. On the other hand, reproduced image data decoded and output by the image data reproducing unit 7 is input to the input terminal 622. The representative image data input via the input terminal 621 is input to the terminal a of the switch 624, and the reproduced image data input via the input terminal 622 is input to the terminal b of the switch 624. A thumbnail generation input switching signal is input from the control unit 2 to the input terminal 623.

  The switch 624 switches between the representative moving image data input to the terminal a via the input terminal 621 and the reproduction image data input to the terminal b via the input terminal 622 according to the thumbnail generation input switching signal. output to c. The image data output from the terminal c of the switch 624 is output to the resizing unit 625.

  The resizing unit 625 performs resizing processing (mainly reduction processing) on the input image data, and outputs the resized image data to the thumbnail image data encoding unit 626.

  In the thumbnail image data encoding unit 626, MPEG2, MPEG4, H.264, and so on. Encoding thumbnail image data is generated by performing encoding using a moving image encoding method such as H.264 or a still image encoding method such as JPEG. Here, since the representative moving image data is also a collection of representative image data that is still image data, it is assumed that encoding is performed by a still image encoding method in the same manner as representative still image data and reproduction stop image data. Yes, but not limited to this. Even when the thumbnail image data is generated and the encoding is controlled for each time (for each frame) and the encoding method is different for each data, if the decoding can be controlled for each data when the thumbnail image data is reproduced, Each may have a different encoding method. The encoded thumbnail image data output from the thumbnail image data encoding unit 626 is output via the output terminal 627.

  The encoded thumbnail image data output from the output terminal 627 of the thumbnail image data generation unit 62 is input to the thumbnail image data management unit 63 via the input terminal 631. The encoded thumbnail image data input via the input terminal 631 is input to the terminal a of the switch 632. A thumbnail distribution signal is input from the control unit 2 to the input terminal 639a.

  The switch 632 distributes the output destination of the encoded thumbnail image data input to the terminal a to the terminals b, c, and d based on the thumbnail distribution signal input from the input terminal 639a.

  The terminal b of the switch 632 is connected to the thumbnail representative moving image data management unit 633, is input via the input terminal 621 of the thumbnail image data generation unit 62, and is encoded thumbnail encoded by the thumbnail image data encoding unit 626. Image data (hereinafter also referred to as “encoded thumbnail representative moving image data”) is input to the thumbnail representative moving image data management unit 633 via the terminal b. Also, the terminal c of the switch 632 is connected to the thumbnail representative still image data management unit 634, is input via the input terminal 621 of the thumbnail image data generation unit 62, and is encoded by the thumbnail image data encoding unit 626. Still image data (hereinafter also referred to as “encoded thumbnail representative still image data”) is input to the thumbnail representative still image data management unit 634 via the terminal c. On the other hand, the terminal d of the switch 632 is connected to the thumbnail reproduction stop image data management unit 635, input through the input terminal 622 of the thumbnail image data generation unit 62, and reproduced by the thumbnail image data encoding unit 626. Stop image data (hereinafter also referred to as “encoded thumbnail reproduction stop image data”) is input to the thumbnail reproduction stop image data management unit 635 via the terminal d.

  The thumbnail representative moving image data management unit 633 manages control information such as time information of the encoded thumbnail representative moving image data input via the terminal b of the switch 632 and also encodes the encoded information via the input / output terminal 636a. The thumbnail representative moving image data is output to the image data recording unit 5. The thumbnail representative still image data management unit 634 manages control information such as time information of the encoded thumbnail representative still image data input via the terminal c of the switch 632, and encodes the encoded information via the input / output terminal 636b. The thumbnail representative still image data is output to the image data recording unit 5. The thumbnail reproduction stop image data management unit 635 manages control information such as time information of the encoded thumbnail reproduction stop image data input via the terminal c of the switch 632 and also encodes the encoded information via the input / output terminal 636c. The thumbnail reproduction stop image data is output to the image data recording unit 5.

  In the image data recording unit 5, the encoded thumbnail representative moving image data output from the thumbnail image data management unit 63 via the input / output terminal 636a, the encoded thumbnail representative still image data output via the input / output terminal 636b, And the encoded thumbnail reproduction stop image data output via the input / output terminal 636c, respectively.

<Operation of Thumbnail Display Before Playback in Image Recording / Playback Device>
Subsequently, an operation before reproduction in the image recording / reproducing apparatus 101 according to the first embodiment, that is, an operation of thumbnail display will be described. In this case, in order to confirm what kind of content each image data has, a plurality of recorded moving image data are displayed as thumbnails on the screen of the display unit 8. In addition, the display part 8 may be comprised with one screen, and if the user can confirm the content of each image data, it may be comprised with several screens.

  In order to perform such display, the control unit 2 needs to control the thumbnail image data processing unit 6 and output thumbnail image data corresponding to each moving image data from the thumbnail image data processing unit 6. In order to output thumbnail image data from the thumbnail image data processing unit 6, the thumbnail image data processing unit 6 reads out encoded thumbnail image data corresponding to each moving image data recorded and stored in the image data recording unit 5. It is necessary to decode and generate thumbnail image data.

  Here, FIG. 6 shows a flow until the thumbnail image data is displayed on the display unit 8. First, representative moving image data is extracted from moving image data input to the image recording / reproducing apparatus 101 using image information (ST11). Next, the extracted representative moving image data is subjected to thumbnail image processing to generate thumbnail image data (ST12). Finally, the generated thumbnail image data is displayed on the display unit 8. The following paragraphs will be explained step by step. FIG. 6 shows the flow until the thumbnail image data is displayed on the display 8. However, the thumbnail image data generation (ST11, ST12) and the thumbnail image data display (ST13) are continuous operations. There is no need. After the thumbnail image data is generated, the thumbnail image data is displayed on the display unit 8 according to a user instruction.

  First, for each image data recorded in the image data recording unit 5, the control unit 2 notifies the thumbnail image data processing unit 6 of the reproduction state for each image data. This playback status includes: “Has been played in the past”, “Has never been played”, “How far has it been played during playback”, “Has been played to the end”, Information such as “which video image thumbnail image data is to be output next” is included, but the present invention is not limited to this. The thumbnail image data processing unit 6 notifies the thumbnail image data management unit 63 of the playback state for each moving image data input from the control unit 2.

  In the thumbnail image data management unit 63, the thumbnail representative moving image data management unit 633, the thumbnail representative still image data management unit 634, and the thumbnail reproduction stop image according to the reproduction order and reproduction state of each image data input from the control unit 3 The data management unit 635 is controlled to read out necessary encoded thumbnail image data from the image data recording unit 5 via the input / output terminals 636a, 636b, and 636c, respectively.

  When the encoded thumbnail representative moving image data is requested, the encoded thumbnail representative moving image data is input as the encoded thumbnail image data from the input / output terminal 636a and input to the terminal b of the switch 637. When the encoded thumbnail representative still image data is requested, the encoded thumbnail representative still image data is input from the input / output terminal 636b and input to the terminal c of the switch 637. When the encoded thumbnail reproduction stop image data is requested, the encoded thumbnail reproduction stop image data is input from the input / output terminal 636c and input to the terminal d of the switch 637. The switch 637 switches the output to the terminal a at the terminals b, c, and d in accordance with the reproduction state of each image data input from the control unit 2. The encoded thumbnail image data output from the terminal a of the switch 637 is output to the thumbnail image data reproduction unit 64 via the output terminal 638.

  The encoded thumbnail image data output from the thumbnail image data management unit 63 via the output terminal 638 is input to the thumbnail image data reproduction unit 64 via the input terminal 641 and input to the internal thumbnail image data decoding unit 642. The The thumbnail image data decoding unit 642 decodes the encoded thumbnail image data input via the input terminal 641. Thumbnail image data obtained as a result of decoding is output via the output terminal 643.

  The thumbnail image data output from the thumbnail image data reproduction unit 64 is input to the display unit 8. In the display unit 8, thumbnail image data corresponding to each image data is displayed in the display area of each thumbnail image data.

  Thumbnail display will be described with reference to FIG. FIG. 8A shows an example of thumbnail display when all recorded moving image data has not been reproduced yet. In such a case, the display unit 8 of the image recording / playback apparatus 101 according to the first embodiment has thumbnail representative moving images corresponding to the image data as shown in FIG. Data is displayed. That is, all thumbnail image data is a moving image display.

  Here, the representative moving image display which is the moving image display will be described. In the case where the representative moving image data is displayed on the display unit 8, first, the representative moving image data selected by the representative image data extracting unit 61 among the moving image data input via the input terminal 3a at the time of recording. The thumbnail image data generation unit 62 resizes the thumbnail image data. Further, after the resizing, the thumbnail representative moving image data is compressed and encoded and is managed as the encoded thumbnail representative moving image data by the thumbnail representative moving image data management unit 633 in the thumbnail image data management unit 63 and is recorded in the image data recording unit 5. The Then, at the time of reproduction, the encoded thumbnail representative moving image data recorded in the image data recording unit 5 is read from the thumbnail representative moving image data management unit 633 in the thumbnail image data management unit 63 and reproduced as thumbnail image data. The data is decoded by the unit 64 and input to the display unit 8 as thumbnail image data. Finally, by updating the thumbnail representative image data with time, the state in which frame advance is displayed becomes the representative moving image display.

  The thumbnail image data of the image data selected as the representative image data by the representative image data extraction unit 61 is displayed in time order. When the thumbnail image data is displayed up to the last frame, it is returned to the first frame and repeatedly displayed. In this way, by displaying the representative image data corresponding to the representative image data in time order and using the representative moving image display, the contents of the recorded moving image data can be grasped throughout.

<Operation of Thumbnail Display after Playback in Image Recording / Playback Device>
Next, the operation when the operation unit 1 is operated from the state of FIG. 8A to select thumbnail image data displayed in the title 6 of the display unit 8 and the reproduction process is performed will be described. In this case, as shown in FIG. 7, first, the user selects arbitrary thumbnail image data from a plurality of thumbnail image data displayed on the display unit 8 (ST21). Next, moving image data corresponding to the selected thumbnail image data is reproduced (ST22). Here, when the user stops playback during the playback process (ST23), the image recording / playback apparatus 101 extracts playback stop image data based on the image data at the playback stop position (ST24). Further, in order to generate thumbnail playback stop image data based on the playback stop image data, the image recording / playback apparatus 101 performs thumbnail image processing (ST25), and displays the generated thumbnail playback stop image data on the display unit 8. . Details will be described below.

  The control unit 2 receives a reproduction command from the operation unit 1 and controls the image data reproduction unit 7. In the image data reproducing unit 7, there is a moving image data decoding unit 71. The moving image data decoding unit 71 reads out the encoded moving image data from the image data recording unit 5, decodes it, and outputs the moving image data obtained as a result of decoding to the display unit 8. In the display unit 8, the screen is controlled, and this moving image data is displayed in the display area of the reproduced image data on the screen.

  Thereafter, when the reproduction process of the image data of the title 6 is stopped, the control unit 2 receives a reproduction stop command from the operation unit 1, controls the image data reproduction unit 7, and the moving image data decoding unit 71 And the image data displayed on the display unit 8 at the end of the reproduction process, that is, the reproduction stop image data is output from the image data reproduction unit 7 to the thumbnail image data processing unit 6.

  The reproduction stop image data input to the thumbnail image data processing unit 6 is input to the thumbnail image data generation unit 62 via the input terminal 622. The reproduction stop image data input to the terminal b of the switch 624 through the input terminal 622 is output from the terminal c of the switch 624 by a thumbnail generation input switching signal input from the control unit 2 through the input terminal 623. Then, the resizing process is performed by the resizing unit 625, the thumbnail image data encoding unit 626 is encoded, and the encoded thumbnail reproduction stop image data is output to the thumbnail image data management unit 63 via the output terminal 627. In the thumbnail image data management unit 63, the encoded thumbnail reproduction stop image data input via the input terminal 631 is input to the terminal a of the switch 632. By the thumbnail distribution signal input from the control unit 2 via the input terminal 639a, the terminal a is connected to the terminal d, and the encoded thumbnail reproduction stop image data is input from the terminal d to the thumbnail reproduction stop image data management unit 635. Control information such as time information is managed. The encoded thumbnail reproduction stop image data is output to the image data recording unit 5 via the input / output terminal 636c, and is recorded and stored in the image data recording unit 5.

  On the other hand, the thumbnail reproduction stop image data management unit 635 inputs the encoded thumbnail reproduction stop image data to the terminal d of the switch 637. In this case, since the control unit 2 outputs a selection signal for requesting the display of thumbnail reproduction stop image data for the title 6, the switch 637 is switched to the terminal d based on this selection signal. The encoded thumbnail image data output from the terminal a of the switch 637 is output to the thumbnail image data reproduction unit 64 via the output terminal 638.

  Further, the encoded thumbnail reproduction stop image data output from the thumbnail image data management unit 63 via the output terminal 638 is input to the thumbnail image data reproduction unit 64 via the input terminal 641, and the internal thumbnail image data decoding unit. 642 is input. The thumbnail image data decoding unit 642 decodes the encoded thumbnail image data input via the input terminal 641. Thumbnail playback stop image data obtained as a result of decoding is output via the output terminal 643.

  The thumbnail reproduction stop image data output from the thumbnail image data reproduction unit 64 is input to the display unit 8. In the display unit 8, thumbnail reproduction stop image data is displayed in the display area of the title 6.

  In the above description, the encoded thumbnail reproduction stop image data is directly output from the thumbnail reproduction stop image data management unit 635. However, the encoded thumbnail reproduction stop image data may be read out and output from the image data recording unit 5. Good.

  FIG. 8B shows an example in which the display of the display unit 8 is returned to the thumbnail display after the reproduction of the moving image data of the selected title 6 is stopped. As shown in the figure, the title 6 in the thumbnail display is the playback stop image display. Here, the reproduction stop image display means that the encoded thumbnail reproduction stop image data created at the time of reproduction stop recorded in the image data recording unit 5 is the thumbnail reproduction stop image data management unit 635 in the thumbnail image data management unit 63. , Is decoded by the thumbnail image data reproduction unit 64, is input to the display unit 8 as thumbnail reproduction stop image data, and is displayed as a still image.

  As described above, the thumbnail image data corresponding to the moving image data subjected to the reproduction processing is displayed as a still image, and the thumbnail image data corresponding to the other moving image data not subjected to the reproduction processing is displayed as the moving image display. Therefore, it is possible to easily grasp and recognize how far the user has reproduced the moving image data. Accordingly, when the thumbnail display screen is confirmed, it is clear how far the playback has been performed and the playback stop position.

  Note that, as shown in FIG. 8 (2), the representative moving image may be displayed by controlling the control unit 2 from the operation unit 1 for the title 6 displaying the reproduction stop image. For example, the position (time) occupied in the moving image data input to the image recording / reproducing apparatus 101 is compared for the time information in the encoded thumbnail reproduction stop image data and the encoded thumbnail representative moving image data. The time information of the encoded thumbnail reproduction stop image data is managed by the thumbnail reproduction stop image data management unit 635, and the time information of the encoded thumbnail representative moving image data is managed by the thumbnail representative moving image data management unit 633. Therefore, the thumbnail image data management unit 63 reads the encoded representative image data of the encoded thumbnail representative moving image data after the encoded thumbnail reproduction stop image data from the image data recording unit 5, and the thumbnail image data reproduction unit 64 Decoding and outputting the thumbnail image data obtained as a result of the decoding to the display unit 8, the display unit 8 displays in a predetermined thumbnail image data display area. Note that it is not always necessary to shift to the representative moving image display via the playback stop image display. For the moving image played back halfway along with the thumbnail display, the thumbnail of the representative moving image after the stop of the playback as described above. You may comprise so that it may express by.

  When playback is performed up to the last thumbnail representative image data, the processing returns to the thumbnail representative image data of the encoded thumbnail representative moving image data after the first read encoded thumbnail playback stop image data, and the process is repeated until playback is stopped. The contents of moving image data can be grasped.

  Next, the operation when the operation unit 1 is operated to select the thumbnail moving image data displayed in the title 7 of the display unit 6 and the reproduction process is performed to the end will be described. When playback is stopped, encoded thumbnail playback stop image data is created as described above.

  FIG. 8 (3) shows an example in which the display of the display unit 8 is returned to the thumbnail display after the selected moving image data is reproduced to the end. At this time, the title 7 in the thumbnail display becomes the representative still image display. Here, the representative still image display means that the encoded thumbnail representative still image data recorded in the image data recording unit 5 is read from the thumbnail representative still image data management unit 634 in the thumbnail image data management unit 63. The thumbnail image data reproduction unit 64 decodes the thumbnail image data and inputs it to the display unit 8 to display a still image. By displaying the representative still image, it is possible to easily determine that the moving image data of the title 7 has already been reproduced to the end.

  For example, the following method is used to determine whether the reproduction process has been performed to the end. First, when the recording start position of moving image data is set to 0, it is set as the reproduction position F (how far it has been reproduced) of the encoded thumbnail reproduction stop image data created when the reproduction is stopped, and the encoded thumbnail representative video created at the time of recording is recorded. Of the encoded thumbnail representative image data constituting the image data, the encoded thumbnail representative image data Fend having the slowest recording position (where is the final representative image data). At this time, the case where F> Fend is the case where the reproduction process is performed to the end. That is, since Fend is the last representative image data, when reproduction is stopped beyond that, it is determined that the selected moving image data has been reproduced to the end.

<Representative image data candidate extraction process>
Next, an outline of the flow of the representative image data candidate extraction process in the representative image data determination unit 606 when creating the encoded thumbnail representative moving image data will be described with reference to FIG.

  First, based on the image information of moving image data input to the image recording / reproducing apparatus 101, a first representative image data candidate period is set as a candidate period for extracting representative moving image data from the moving image data (ST31). ). Next, a second representative image data candidate period is further set from the first representative image data candidate period based on the recording capacity of the image data recording unit 5 (ST32). Here, representative moving image data is extracted from the set second representative image data candidate period (ST33), and thumbnail image processing is performed (ST34). Hereinafter, the details of the extraction process will be described with reference to FIGS. 10 and 13.

  The first representative image data candidate period shown in FIG. 10A is set from the scene change detection signal output from the scene change detection unit 603 and the volume sound quality change detection signal output from the volume sound quality change detection unit 604. To do. Specific examples include a program main period and a commercial period (hereinafter also referred to as “CM period”) such as a television program. For example, the program main period is set as the first representative image data candidate period. At this time, the CM period is the remaining recording time that is not the first representative image data candidate period.

  Then, a second representative image data candidate period is set from the sampling period which is a control signal from the control unit 2. In FIG. 10A, the first representative image data candidate period is the second representative image candidate period. On the other hand, in FIG. 13A described later, a part of the first representative image data candidate period is a second representative image data candidate period.

  Thereafter, as shown in FIG. 10 (2), the moving image data in the second representative image data candidate period is extracted at a sampling period which is a control signal from the control unit 2, and the representative moving image data is extracted. The representative moving image data is resized by the resizing unit 625 to become thumbnail representative moving image data as shown in FIG. 10 (3), encoded by the thumbnail image data encoding unit 626, and encoded thumbnail representative moving image. The data is recorded in the image data recording unit 5.

  Here, as described above, the representative moving image data is constituted by representative image data, and in particular, one image data in the representative image data is also referred to as representative still image data. The thumbnail representative still image data corresponding to the representative still image data is one of thumbnail representative image data constituting the thumbnail representative moving image data, and is generated from, for example, the first representative image data Fstart of the representative moving image data. Thumbnail image data.

  The thumbnail representative still image data is not limited to this, and conversely, thumbnail image data generated from the thumbnail representative image data Fend after the thumbnail representative moving image data may be used. Further, the thumbnail representative moving image data management unit 633 in the thumbnail image data management unit 63 is controlled from the operation unit 1 via the control unit 2, and any encoded thumbnail representative image data in the encoded thumbnail representative moving image data is controlled. It may be configured to select and register the thumbnail representative still image data management unit 634 as encoded thumbnail representative still image data. Further, the thumbnail reproduction stop image data management unit 635 in the thumbnail image data management unit 63 is controlled so that the encoded thumbnail reproduction stop image data is registered in the thumbnail representative still image data management unit 634 as encoded thumbnail representative still image data. You may comprise.

  FIGS. 11A and 11B show an example of a temporal relationship between thumbnail representative moving image data and the moving image data reproduction process input to the image recording / reproducing apparatus 101. FIG. As shown in the drawing, there is no thumbnail representative moving image data in a period that is not the second representative image data candidate period. On the other hand, in the second representative image data candidate period, thumbnail representative moving image data exists with frames thinned out. (Note that the image data Fstop is not the image data constituting the thumbnail representative moving image data, but is shown in FIG. 11 (1) for convenience because it represents the positional relationship between image data F0 and F1 described later. Yes.)

  FIG. 11 (3) shows a state where the reproduction processing of the moving image data by the image data reproduction unit 7 is finished with the frame of the image data Fstop. As shown in the figure, the thumbnail representative moving image data is subjected to thinning processing when compared with the moving image data. Therefore, there may be no thumbnail representative image data corresponding to the final image data Fstop of the reproduction process. When such reproduction is stopped, the thumbnail image data generation unit 62 in the thumbnail image data processing unit 6 generates thumbnail reproduction stop image data that is thumbnail image data corresponding to the final reproduction frame Fstop.

  Then, as shown in FIG. 11 (4), the thumbnail image data corresponding to the image data Fstop generated as the thumbnail reproduction stop image data and the image data Fstop are closest to the image data Fstop by the command from the control unit 2. The thumbnail representative image data corresponding to the image data F0 satisfying F0 <Fstop and the thumbnail representative image data of the image data F1 satisfying F1> Fstop closest to the image data Fstop are selected. Finally, the image recording / reproducing apparatus 101 selects one of these thumbnail image data and displays it on the display unit 8.

  Here, when the sampling period is long, the difference between the contents of the three thumbnail image data is large. The thumbnail reproduction stop image data corresponding to the image data Fstop generated when the reproduction is stopped has an effect of indicating the image data of the screen on which the operator has stopped reproduction. On the other hand, the thumbnail representative image data of the image data F0 that satisfies F0 <Fstop closest to the image data Fstop has an effect of notifying the operator that at least the image data F0 has been reproduced. Further, the thumbnail representative image data of the image data F1 that satisfies F1> Fstop closest to the image data Fstop has an effect of informing the operator of the contents of the image data displayed on the screen during the next reproduction.

  Further, FIGS. 12A and 12B show another example of the time relationship between the thumbnail representative moving image data and the reproduction processing of the moving image data input to the image recording / reproducing apparatus 101. FIG. In such a state, FIG. 12 (3) shows a state in which the reproduction processing by the image data reproduction unit 7 ends with a frame called image data Fstop. That is, in FIG. 12 (3), the reproduction process is stopped during a period that is not the second representative image data candidate period, for example, during the CM period. (Note that the image data Fstop is not image data constituting the thumbnail representative moving image data, but is shown in FIG. 12 (1) for the sake of convenience in order to represent the positional relationship between image data F0 and F1 described later. Yes.)

  In this case, the thumbnail image data corresponding to the image data Fstop is a frame during the CM period. On the other hand, the image data F0 is the last representative image data before the CM period, and the image data F1 represents the first representative image data after the CM period.

  Then, as shown in FIG. 12 (4), the thumbnail representative image data corresponding to the image data Fstop and the image data Fstop generated most at the time of the reproduction stop as the thumbnail reproduction stop image data by the command from the control unit 2 are the most. The thumbnail representative image data corresponding to the image data F0 that satisfies F0 <Fstop and the thumbnail representative image data of the image data F1 that satisfies F1> Fstop closest to the image data Fstop are selected.

  Similarly to the case of FIG. 11, the thumbnail reproduction stop image data corresponding to the image data Fstop generated when the reproduction is stopped has an effect of indicating the image data of the screen on which the operator has stopped reproduction. On the other hand, the thumbnail representative image data of the image data F0 that satisfies F0 <Fstop closest to the image data Fstop has an effect of notifying the operator that at least the image data F0 has been reproduced. Further, the thumbnail representative image data of the image data F1 that satisfies F1> Fstop closest to the image data Fstop has an effect of informing the operator of the contents of the image data displayed on the screen during the next reproduction. Finally, the image recording / reproducing apparatus 101 selects one of these thumbnail image data and displays it on the display unit 8.

  Next, FIG. 13 (1) shows an example in which a part of the first representative image data candidate period is the second representative image data candidate period. Taking an example of the main program period and the commercial period, the main program period is the first representative image data candidate period and the commercial period is not the first representative image data candidate period. In addition, when the thumbnail image data is created from the first few minutes of the main program period, the second representative image data candidate period is the first few minutes of each main program period.

  Thus, it is advantageous in terms of memory capacity to create thumbnail image data only for several minutes after the screen is switched. At this time, the portion that is in the first representative image data candidate period and is not in the second representative image data candidate period is naturally not the CM period. For example, for the purpose of reducing used memory, thumbnail image data This is the main part of the program that has been excluded from the creation of. Therefore, when there is sufficient memory capacity, this corresponds to a period for extracting representative image data.

  Further, as shown in FIG. 13 (2), in order to create representative image data, moving image data in the second representative image data candidate period is extracted at a sampling period which is a control signal from the control unit 2, and the representative image data is extracted. Extract moving image data. The extracted representative moving image data is resized by the resizing unit 625, becomes thumbnail representative moving image data as shown in FIG. 13 (3), is encoded by the thumbnail image encoding unit 626, and is encoded thumbnail representative. It is recorded in the image data recording unit 5 as moving image data.

  Next, not all of the first representative image data candidate periods are the second representative image data candidate periods, and a part of the first representative image data candidate periods is the second representative image data candidate periods. In the case where the reproduction processing of moving image data input to the image recording / reproducing apparatus 101 is stopped at a position that is in the first representative image data candidate period and not in the second representative image data candidate period. The thumbnail reproduction stop image data will be described with reference to FIG.

  FIGS. 14A and 14B show an example of a time relationship between thumbnail representative moving image data and moving image data reproduction processing input to the image recording / reproducing apparatus 101. FIG. A state in which the moving image data reproduction process in the image data reproducing unit 7 ends in the frame of the image data Fstop in the first representative image data candidate period and not in the second representative image data candidate period. This is shown in FIG. 14 (3).

  In such a case, the thumbnail image data generation unit 62 in the thumbnail image data processing unit 6 generates thumbnail image data for the final reproduction image data Fstop, and the thumbnail reproduction stop image data is generated when reproduction is stopped. Thumbnail image data corresponding to the selected image data Fstop is selected. As shown in FIGS. 11 and 12, the thumbnail image data corresponding to the image data F0 closest to the image data Fstop and corresponding to the image data F0 corresponding to F0 <Fstop, and the image data F1 corresponding to F1> Fstop closest to the image data Fstop are supported. The thumbnail image data to be used may be thumbnail reproduction stop image data.

  FIG. 15 shows an example in which the playback state of each moving image data is displayed during thumbnail display. As shown in the figure, a reproduction status bar indicating a reproduction state is provided under each thumbnail image data. Note that “representing the playback state” may be “representing the playback stop position”.

  Here, the playback status bar indicates that the left end is 0% and the right end is 100%, and that the playback status bar has been played back to the blackened position. Therefore, the title 6 has a reproduction status bar indicating about 50%, and the display is a reproduction stop image display. That is, it means that the playback process has been completed up to the vicinity of the position (image data) where the playback stop image is displayed, which has been played back about 50%.

  Title 9 has a playback status bar of about 20% and is a representative moving image display. As in the case of the title 6, the reproduction processing of the moving image data corresponding to the thumbnail image data of the title 9 has been completed up to about 20%, but the initial setting or the control in response to the operation from the operation unit 1 is performed. This is a state in which the display is switched to the representative moving image display by the command of the unit 2. That is, thumbnail images are repeatedly displayed for representative moving image data of about 20% or more of the title 9.

  Title 7 has a playback status bar of 100% and is a representative still image display. In other words, this indicates that all the playback processing of the moving image data of title 7 has been completed. Title 1 has a playback status bar of 0% and is a representative still image display. In the present embodiment, since the representative moving image is displayed when it is not played back, the title 1 has been played back, and the playback position is set by the initial setting or the command of the control unit 2 that has received an operation from the operating unit 1. Indicates that the image data has returned to the beginning of the moving image data.

  In addition, title 2, title 3, title 4, title 5, and title 8 are representative moving image displays that have not been played back. In the representative moving image display, thumbnail moving image data corresponding to the representative moving image data is displayed, and the thumbnail representative image data is displayed by frame advance in time order. In this case, the blackened range of the playback status bar may be changed in accordance with the frame advance display. Specifically, in the title 5, the blackened range of the playback status bar moves from 0% to 100% in synchronization with frame advance playback. On the other hand, in the title 9, the blackened range of the playback status bar moves in the range of approximately 20% to 100% in synchronization with the frame advance playback. Thereby, even if it is a representative moving image display, a user or an operator can recognize whether reproduction processing was performed about each moving image data.

  Further, the function of the reproduction status bar is expanded and configured to be operated from the operation unit 1 via the control unit 2, thereby moving the representative image data of the moved destination by moving the blacked range of the reproduction status bar. It is also possible to display thumbnail image data corresponding to.

  As described above, the image recording / reproducing apparatus 101 according to the first embodiment controls the thumbnail image data processing unit 6 so that the moving image data that has not yet been reproduced in the thumbnail display on the display unit 8 is representative. It is possible to perform a moving image display, a reproduction stop image display for a moving image being reproduced, and a representative still image display for a reproduced moving image. Accordingly, the moving image data that has been subjected to the reproduction process is displayed as a still image, and the moving image data that has not been subjected to the reproduction process is displayed as a moving image, so that the reproduction state for each moving image data can be easily determined. Furthermore, since moving image data that has not been subjected to reproduction processing is displayed as a moving image, it is possible to grasp the content that has not been reproduced.

  Furthermore, in the representative image data determination unit 606 of the image recording / playback apparatus 101 according to the first embodiment, the scene change detection signal output from the scene change detection unit 603 and the volume sound quality change output from the volume sound quality change detection unit 604 are displayed. Although the first representative image data candidate period is set using the detection signal, the present invention is not limited to this. That is, as long as it is image information obtained from moving image data, a signal other than a scene change detection signal or a sound volume change detection signal may be used.

  It goes without saying that the first representative image data candidate period may be set from either one of the scene change detection signal and the sound volume change detection signal. That is, based on the scene change detection signal output from the scene change detection unit 603, a certain period after the scene change change may be configured as the first representative image data candidate period, or the volume sound quality change Based on the sound volume change detection signal from the detection unit 60, the case where there is a certain amount of sound volume may be set as the first representative image data candidate period, and the certain period after the sound volume and sound quality change. May be configured as the first representative image data candidate period.

  Further, in the representative image data determination unit 606 of the image recording / playback apparatus 101 according to the first embodiment, the second representative image data candidate period is set to the first representative image data candidate based on the sampling period from the control unit 2. Although set from the beginning of the period, it is not limited to this. The beginning of the second representative image data candidate period may be set after a certain period from the beginning of the first representative image data candidate period. Also, the setting for a certain period may be specified by time or by the number of frames.

  Further, in the representative image data determination unit 606 of the image recording / playback apparatus 101 according to the first embodiment, based on the sampling period from the control unit 2, the representative image data is spaced from the second representative image data candidate period by a predetermined interval. However, the present invention is not limited to this. For example, the representative image data may be extracted densely at the beginning of the second representative image data candidate period, and the representative image data may be extracted roughly as the distance from the beginning increases. Alternatively, representative image data may be extracted coarsely at the beginning, gradually densely, and coarsely at the end.

  Further, the representative image data candidate period may be set by one extraction process instead of dividing the representative moving image data extraction process into two. In this case, only the setting of the first representative image data candidate period described above may be set, or only the setting of the second representative image data candidate period may be set.

  Furthermore, it goes without saying that the encoding method of the thumbnail image data encoding unit 626 of the image recording / playback apparatus 101 according to the first embodiment is not limited to the still image encoding method, and may be a moving image encoding method. . Furthermore, the encoding method may be different for each thumbnail image data by controlling the thumbnail image data decoding unit 642 in conformity with the decoding.

  In FIG. 8 and FIG. 15, the moving image data that has been played back is displayed as a still image and the moving image data that has not been played back is displayed as a moving image. When playback is performed up to a position of about 50%, title 1, title 2, title 3, and title 4 may be displayed as representative still images, title 5 may be displayed as a stop playback image, and titles 6 through 9 may be displayed as representative moving images.

  In addition to extracting a plurality of representative moving image data from image data consisting of one main program and displaying thumbnail representative moving image data, a plurality of representative moving image data is extracted from image data consisting of a plurality of programs. Then, thumbnail representative moving image data may be displayed. For example, when a plurality of broadcasts of a series program are recorded, thumbnails are displayed for a plurality of broadcast contents, so that the user can easily recognize a broadcast that the user has watched.

  The thumbnail image data recorded in the image data recording unit 5 is encoded thumbnail image data after the encoding process, but thumbnail image data that has not been encoded may be recorded. In particular, when the screen size of the thumbnail image data is small compared to the moving image data input to the image recording / playback apparatus, or when the recording capacity of the image data recording unit 5 is large, it is necessary to encode the thumbnail image data. Low.

  Further, the display unit 8 is not necessarily configured by one screen, and the display unit 8 may be configured by a plurality of screens. For example, each thumbnail image data may be displayed on the screen of each monitor using a plurality of monitors.

  Examples of the use of the image recording / reproducing apparatus of the present invention described above include a DVD (Digital Versatile Disc) recorder, a HDD (Hard Disc Drive) recording / reproducing apparatus, and a hybrid recorder (a combination of a DVD recording / reproducing apparatus and a HDD recording / reproducing apparatus). ) Etc.

1 is a block diagram schematically showing a configuration of an image recording / reproducing apparatus according to Embodiment 1 of the present invention. It is a block diagram which shows roughly the structure of the representative image data extraction part in Embodiment 1 of this invention. It is a block diagram which shows roughly the structure of the thumbnail image data generation part in Embodiment 1 of this invention. It is a block diagram which shows roughly the structure of the thumbnail image data management part in Embodiment 1 of this invention. It is a block diagram which shows roughly the structure of the thumbnail image data reproduction part in Embodiment 1 of this invention. It is a flowchart which shows schematically the production | generation of the thumbnail image data in Embodiment 1 of this invention. It is a flowchart which shows schematically the production | generation of the thumbnail image data in Embodiment 1 of this invention. It is explanatory drawing of an example of the thumbnail display in the display part of the image recording / reproducing apparatus which concerns on Embodiment 1 of this invention. It is a flowchart which shows schematically the setting of the representative image data candidate period in Embodiment 1 of this invention. It is explanatory drawing which shows the setting of the representative image data candidate period in the image recording / reproducing apparatus concerning Embodiment 1 of this invention, representative image data extraction, and thumbnail image processing. FIG. 6 is an explanatory diagram showing thumbnail representative moving image data, moving image data, moving image data reproduction processing, and thumbnail image processing in the image recording / reproducing apparatus according to Embodiment 1 of the present invention. FIG. 6 is an explanatory diagram showing thumbnail representative moving image data, moving image data, moving image data reproduction processing, and thumbnail image processing in the image recording / reproducing apparatus according to Embodiment 1 of the present invention. It is explanatory drawing which shows the setting of the representative image data candidate period in the image recording / reproducing apparatus concerning Embodiment 1 of this invention, representative image data extraction, and thumbnail image processing. FIG. 6 is an explanatory diagram showing thumbnail representative moving image data, moving image data, moving image data reproduction processing, and thumbnail image processing in the image recording / reproducing apparatus according to Embodiment 1 of the present invention. It is explanatory drawing of an example of the thumbnail display in the display part of the image recording / reproducing apparatus which concerns on Embodiment 1 of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 Operation part, 2 Control part, 4 Image data processing part, 5 Image data recording part, 6 Thumbnail image data processing part, 7 Image data reproduction part, 8 Display part, 41 Moving image data encoding part, 61 Representative image data extraction , 62 thumbnail image data generation unit, 63 thumbnail image data management unit, 64 thumbnail image data playback unit, 71 moving image data decoding unit, 603 scene change detection unit, 604 volume sound quality change detection unit, 606 representative image data determination unit, 607 switch, 624 switch, 625 resize unit, 626 thumbnail image data encoding unit, 632 switch, 633 thumbnail representative moving image data management unit, 634 thumbnail representative still image data management unit, 635 thumbnail reproduction stop image data management unit, 6 7 switches, 642 thumbnail image data decoding unit.

Claims (10)

An image recording / reproducing apparatus used in a thumbnail image data display method for displaying a plurality of thumbnail image data on a screen,
An image data processing unit for encoding input moving image data;
Extracting a plurality of image data from the input moving image data and outputting the plurality of thumbnail image data corresponding to each of the extracted plurality of image data;
The encoded image data subjected to the encoding process, and an image data recording unit for recording the plurality of thumbnail image data;
An image data reproduction unit that reproduces the encoded image data;
The thumbnail image data processing unit outputs image data at the time when the reproduction process is stopped, or thumbnail still image data corresponding to image data that is temporally close to the image data,
An image recording / reproducing apparatus, wherein thumbnail moving image data is output as the thumbnail image data corresponding to the image data not subjected to the reproducing process. An image recording / reproducing apparatus used in a thumbnail image data display method for displaying a plurality of thumbnail image data on a screen,
An image data processing unit for encoding input moving image data;
Extracting a plurality of image data from the input moving image data and outputting the plurality of thumbnail image data corresponding to each of the extracted plurality of image data;
The encoded image data subjected to the encoding process, and an image data recording unit for recording the plurality of thumbnail image data;
An image data reproduction unit that reproduces the encoded image data;
The thumbnail image data processing unit outputs thumbnail still image data as thumbnail image data corresponding to the image data for which the reproduction processing has been completed,
An image recording / reproducing apparatus, wherein thumbnail moving image data is output as the thumbnail image data corresponding to the image data not subjected to the reproducing process. Thumbnail still image data that is output as thumbnail image data corresponding to image data that has been reproduced is
The image recording / reproducing apparatus according to claim 2, wherein the image recording / reproducing apparatus is thumbnail image data corresponding to image data displayed before the end of the reproduction process. The thumbnail image data selected from the thumbnail video data is
4. The image recording / reproducing apparatus according to claim 3, wherein the image recording / playback apparatus is the first or last thumbnail image data of the thumbnail moving image data. 3. The image recording / reproducing apparatus according to claim 1, wherein a plurality of pieces of image data are extracted from the input moving image data based on image information of the input moving image data. 6. The image recording / reproducing apparatus according to claim 5, wherein the image information is information relating to a scene change. 6. The image recording / reproducing apparatus according to claim 5, wherein the image information is information related to sound. 6. The method according to claim 5, further comprising: extracting a plurality of image data from the input moving image data based on the image information of the input moving image data, and further extracting the plurality of image data based on the time information. Image recording and playback device. An image data display method for displaying a plurality of thumbnail image data on a screen,
An image data processing step for encoding input moving image data;
An extraction step of extracting a plurality of image data from the input moving image data;
A thumbnail image data processing step of outputting the plurality of thumbnail image data corresponding to each of the extracted plurality of image data;
The encoded image data subjected to the encoding process, and an image data recording step for recording the plurality of thumbnail image data;
An image data reproduction step for reproducing the encoded image data,
The thumbnail image data processing step outputs thumbnail still image data corresponding to image data at the time when the reproduction process is stopped, or image data that is temporally close to the image data,
A display method comprising: outputting thumbnail moving image data as the thumbnail image data corresponding to a portion where the reproduction processing has not been performed. A thumbnail image data display method for generating a plurality of thumbnail image data from input moving image data and displaying the plurality of thumbnail image data on a screen,
The thumbnail image data corresponding to the portion of the moving image data that has been reproduced is displayed as a still image,
A thumbnail image data display method, wherein the thumbnail image data corresponding to a portion of the moving image data that has not been reproduced is a moving image display.

Images