JP4674535B2 - Recording / reproducing apparatus and recording / reproducing method, recording apparatus and recording method, and reproducing apparatus and reproducing method - Google Patents

Description

The present invention relates to a recording and reproducing apparatus and a recording and reproducing method, a recording apparatus and a recording method, and relates to playback apparatus and how, in particular, for example, while suppressing the deterioration of the image of the moving image data, is possible to improve the compression ratio recording and reproducing apparatus and a recording and reproducing method to be, recording apparatus and recording method, and to a playback apparatus and how.

  For example, according to a recording / reproducing apparatus such as a hard disk recorder that records moving image data and reproduces the recorded moving image data, in order to save the recording capacity of the hard disk, for example, MPEG ( By performing encoding (compression) processing such as predictive encoding by the Moving Picture Expert Group) method, the data amount of moving image data is reduced.

It should be noted that by reducing the frame rate and increasing the amount of information per picture (frame or field), the picture quality of the picture is reduced by reducing the amount of information per picture. However, a recording / reproducing apparatus having a mode for encoding a moving image at a normal frame rate is described in Patent Document 1, for example.
JP-A-11-164245

  By the way, in MPEG, for example, predictive coding is performed in units of GOPs using, for example, 15 pictures or the like consecutive in the display order as GOPs (Group Of Pictures). Therefore, when adjacent pictures that make up the GOP are not similar (in display order), when obtaining a predicted image from one picture and using the predicted image to encode the other picture, The code amount increases (compression rate decreases). On the other hand, if the code amount is suppressed, the image quality obtained at the time of decoding deteriorates.

  The present invention has been made in view of such a situation, and is capable of improving the compression rate (reducing the code amount) while suppressing deterioration in image quality.

The recording / reproducing apparatus according to the first aspect of the present invention is a recording / reproducing apparatus that records moving image data on a recording medium and reproduces the moving image data from the recording medium. From the detection means for detecting a scene which is a set of similar series of pictures, and the prediction encoding or the prediction encoding for each scene based on the inter-picture difference value of each picture constituting the scene Selection means for selecting one of the non-predictive encodings representing different encodings as an encoding scheme for encoding a picture included in the scene, and for grouping the scene into similar groups of pictures An acquisition means for acquiring image information to be used, and the scene in which the predictive encoding is selected as the encoding method of the picture based on the image information; Then, grouping means for grouping one or more similar scenes into one group, and first coding means for performing the predictive coding for the pictures constituting the group for each group And a second encoding means for performing the non-predictive encoding on a picture included in the scene for which the non-predictive encoding is selected as the picture encoding method, and obtained by the predictive encoding. Recording control means for recording the first encoded data and the second encoded data obtained by the non-predictive encoding on the recording medium, and decoding the first and second encoded data Read control means for reading the first and second encoded data from the recording medium in decoding order, and the first encoded data read from the recording medium for each group. And first decoding means for performing predictive decoding corresponding to the predictive encoding, and non-predictive corresponding to the non-predictive encoding with respect to the second encoded data read from the recording medium. Second decoding means for performing decoding, and output control means for outputting pictures obtained by the predictive decoding and the non-predictive decoding in display order , wherein the first encoding means uses MPEG as the predictive encoding (Moving Picture Expert Group) encoding, the second encoding means performs intra encoding using wavelet transform as the non-predictive encoding, and the first decoding means as the predictive decoding , MPEG decoding corresponding to the MPEG encoding, and recording means for recording DCT (Discrete Cosine Transform) coefficient obtained in the middle of the MPEG decoding, the second decoding means as the non-predictive decoding , Intra decoding using inverse transform of bullet transform, and when the output control means outputs a picture obtained by the MPEG decoding, the DCT coefficients recorded in the recording means are decoded into the pictures in display order. To output.
The selection means determines whether or not there are a predetermined number or more of pictures having a difference value between pictures equal to or greater than a predetermined value. If it is determined, the non-predictive encoding is selected, and if it is determined that there are no more than the predetermined number of pictures having the inter-picture difference value equal to or greater than the predetermined value, the predictive encoding can be selected.
Among the pictures constituting the scene, the inter-picture difference value of a predetermined picture is the neighboring picture adjacent to the predetermined picture among the pictures constituting the scene and arranged in the display order. Between the pixel values of the pixels at the same position, and the difference between the average values of the pixel values for each block when the predetermined picture and the adjacent picture are divided into blocks. The histogram in the case where the sum of squares of squares, the sum of squares of differences between motion vectors of each pixel in each block, or the histogram of pixel values of the predetermined picture and the histogram of pixel values of the adjacent pictures are created. The sum of squares of the difference between the number of pixels of each pixel value can be made.

  The recording / reproducing apparatus according to the first aspect may further include a creation unit that creates a reduced image obtained by reducing the picture, and the acquisition unit acquires the image information using the reduced image. Can do.

The recording / reproducing apparatus according to the first aspect can be provided with a plurality of the first decoding means.

A recording / reproducing method according to a first aspect of the present invention includes a plurality of pictures in a recording / reproducing method of a recording / reproducing apparatus that records moving image data on a recording medium and reproduces the moving image data from the recording medium. A detection step for detecting a scene which is a set of similar series of pictures from the moving image data, and predictive coding or prediction for each scene based on a difference value between pictures of each picture constituting the scene. A selection step of selecting one of the non-predictive encodings representing encodings different from encoding as an encoding method for encoding a picture included in the scene, and grouping the scenes into similar groups of pictures An acquisition step of acquiring image information used for performing the prediction, and the prediction code as an encoding method of the picture based on the image information A grouping step of grouping one or more similar scenes into one group, and for each group, the predictive coding is performed on the pictures constituting the group. A first encoding step for performing, and a second encoding step for performing the non-predictive encoding on a picture included in the scene for which the non-predictive encoding is selected as the picture encoding method; A recording control step of recording the first encoded data obtained by the predictive encoding and the second encoded data obtained by the non-predictive encoding on the recording medium; and the first and second A read control step of reading out the first and second encoded data from the recording medium in a decoding order for decoding the encoded data, and for each group, the recording A first decoding step for performing predictive decoding corresponding to the predictive encoding for the first encoded data read from the medium, and the second encoded data read from the recording medium respect, the second decoding step of performing a non-prediction decoding corresponding to the non-predictive coding, see contains an output control step of outputting a picture obtained by said prediction decoding and the non-predictive decoding in the display order, the The first encoding step performs MPEG (Moving Picture Expert Group) encoding as the predictive encoding, and the second encoding step performs intra encoding using wavelet transform as the non-predictive encoding. The first decoding step performs MPEG decoding corresponding to the MPEG encoding as the predictive decoding, and the recording / reproducing apparatus performs DCT (Discrete Cosin) obtained in the middle of the MPEG decoding. e Transform) recording means for recording coefficients, wherein the second decoding step performs intra decoding using inverse transformation of the wavelet transform as the non-predictive decoding, and the output control step includes the MPEG decoding When the picture obtained by the above is output, the DCT coefficients recorded in the recording means are decoded into the picture and output in the display order.

In the recording / playback apparatus or recording / playback method according to the first aspect as described above, a scene that is a set of similar pictures is detected from the moving image data including a plurality of pictures. A picture in which one of predictive coding and non-predictive coding representing coding different from the predictive coding is included in the scene for each scene based on an inter-picture difference value of each picture constituting the scene Is selected as an encoding method when encoding the image, and image information used to group the scene into similar groups of pictures is acquired, and based on the image information, the encoding method of the picture is The scenes for which predictive coding is selected, wherein one or more similar scenes are grouped into one group, The predictive coding is performed on the pictures constituting the group, and the non-predictive coding is performed on the pictures included in the scene in which the non-predictive coding is selected as the picture coding method. The first encoded data obtained by the predictive encoding and the second encoded data obtained by the non-predictive encoding are recorded on the recording medium, and the first and second The first and second encoded data are read from the recording medium in a decoding order for decoding the encoded data, and the first encoded data read from the recording medium is read for each group. Predictive decoding corresponding to the predictive encoding is performed, and non-predictive decoding corresponding to the non-predictive encoding is performed on the second encoded data read from the recording medium, prediction No. and the a picture obtained by the non-predictive decoding is output to the display order. As the predictive coding, MPEG (Moving Picture Expert Group) coding is performed, as the non-predictive coding, intra coding using wavelet transform is performed, and as the predictive decoding, the MPEG coding is performed. When the corresponding MPEG decoding is performed, intra decoding using inverse wavelet transform is performed as the non-predictive decoding, and the picture obtained by the MPEG decoding is output, the obtained in the middle of the MPEG decoding DCT coefficients are decoded into the picture in the display order and output.

A recording apparatus according to a second aspect of the present invention is a recording apparatus that records moving image data on a recording medium, and detects a scene that is a set of similar pictures from the moving image data including a plurality of pictures. And detecting means that performs predictive coding or non-predictive coding representing coding different from the predictive coding for each scene based on the inter-picture difference value of each picture constituting the scene, Selection means for selecting a coding method for coding a picture included in a scene; acquisition means for obtaining image information used for grouping the scene into similar groups of pictures; and Based on the scene, the predictive coding is selected as the picture coding method, and one or more similar scenes are grouped into one group. A grouping means for dividing a loop; a first encoding means for performing the predictive encoding on the pictures constituting the group for each group; and the non-predictive encoding as the picture encoding method. A second coding means for performing the non-predictive coding on the picture included in the selected scene, the first coded data obtained by the predictive coding, and the non-predictive coding; Recording control means for recording the obtained second encoded data on the recording medium , wherein the first encoding means performs MPEG encoding as the predictive encoding, and the second code The converting means performs intra encoding using wavelet transform as the non-predictive encoding.

The recording apparatus of the second aspect, the first and second encoded data recorded on the recording medium, be further provided a transmission control means for transmitting to another device for reproducing the moving image data it can.

A recording method according to a second aspect is a recording method of a recording apparatus that records moving image data on a recording medium, and detects a scene that is a set of similar pictures from the moving image data including a plurality of pictures. And performing one of predictive coding and non-predictive coding representing coding different from the predictive coding, for each scene, based on the inter-picture difference value of each picture constituting the scene. A selection step of selecting a picture included in a scene as an encoding method for encoding, an acquisition step of acquiring image information used to group the scene into similar groups of pictures, and the image information Based on the scene in which the predictive coding is selected as the picture coding method, and the one or more similar scenes are A grouping step for grouping into groups, a first coding step for performing the predictive coding on the pictures constituting the group for each group, and the non-prediction as a coding method for the pictures A second encoding step for performing the non-predictive encoding on a picture included in the scene for which encoding has been selected, first encoded data obtained by the predictive encoding, and the non-predictive the second encoded data obtained by encoding, see contains a recording control step of recording on the recording medium, wherein the first encoding step, as the predictive coding, performs MPEG encoding, wherein In the second encoding step, intra encoding using wavelet transform is performed as the non-predictive encoding.

In the recording apparatus or recording method according to the second aspect as described above, a scene that is a set of similar series of pictures is detected from the moving image data including a plurality of pictures, and the detected scene is detected. For each scene, one of predictive coding or non-predictive coding representing coding different from the predictive coding codes a picture included in the scene based on the inter-picture difference value of each picture constituting Image information used for grouping the scenes into similar groups of pictures is acquired, and based on the image information, the prediction code is selected as the picture encoding method. One or more similar scenes are grouped into one group, and for each group, the scene The predictive coding is performed on the pictures constituting the loop, and the non-predictive coding is performed on the pictures included in the scene for which the non-predictive coding is selected as the picture coding method. First encoded data obtained by the predictive encoding and second encoded data obtained by the non-predictive encoding are recorded on the recording medium. Note that MPEG encoding is performed as the predictive encoding, and intra encoding using wavelet transform is performed as the non-predictive encoding.

According to a third aspect of the present invention, there is provided a playback device that plays back moving image data, detects a scene that is a set of similar pictures from the moving image data including a plurality of pictures, and Based on the inter-picture difference value of each picture constituting a scene, for each of the scenes, one of predictive coding or non-predictive coding representing coding different from the predictive coding is converted into a picture included in the scene. Selected as an encoding method for encoding, and based on image information used to group the scene into similar groups of pictures, the predictive encoding is selected as the encoding method of the picture One or more scenes that are similar to each other are grouped into one group, and for each group, a picture constituting the group As the predictive coding with respect to the picture included in the scene where the first encoded data, and the non-prediction coding as the coding method of the picture obtained by performing MPEG encoding is selected As the non-predictive encoding, the first and second encoded data are recorded from the recording medium on which the second encoded data obtained by performing intra encoding using wavelet transform is recorded. Read control means for reading out the first and second encoded data in the decoding order for decoding, and the predictive encoding for the first encoded data read from the recording medium for each group A first decoding means for performing predictive decoding corresponding to the non-predictive encoding for the second encoded data read from the recording medium. And second decoding means, said an output control means for outputting a picture obtained by the prediction decoding and the non-predictive decoding in the display order, the first decoding means, as the prediction decoding, corresponding to the MPEG encoding Recording means for recording the DCT coefficient obtained in the middle of the MPEG decoding, and the second decoding means uses intra-decoding using inverse transform of the wavelet transform as the non-predictive decoding The output control means, when outputting a picture obtained by the MPEG decoding, causes the DCT coefficients recorded in the recording means to be decoded and output to the picture in the display order.

The playback device according to the third aspect may further include reception control means for receiving the first and second encoded data transmitted from another device, and the recording medium includes the reception control. The first and second encoded data received by the means can be recorded.

A playback method according to a third aspect of the present invention is a playback method for a playback device that plays back moving image data, and detects a scene that is a set of similar series of pictures from the moving image data composed of a plurality of pictures. Then, based on the inter-picture difference value of each picture constituting the scene, the scene includes one of predictive coding and non-predictive coding representing coding different from the predictive coding for each scene. Selected as the encoding method when encoding the picture to be encoded, and the predictive encoding is selected as the encoding method for the picture based on the image information used to group the scenes into similar groups of pictures The one or more similar scenes are grouped into one group, and the group is configured for each group. As the prediction encoding on puncturing, pictures included in the scene where the first encoded data obtained, and the non-prediction coding as the coding method of the picture is selected by performing MPEG encoding On the other hand, as the non-predictive encoding, the first and second encodings are performed from the recording medium on which the second encoded data obtained by performing intra encoding using wavelet transform is recorded. A read control step of reading out the first and second encoded data in decoding order for decoding data, and the prediction for the first encoded data read from the recording medium for each group A first decoding step that performs predictive decoding corresponding to encoding, and the non-predictive encoding corresponding to the second encoded data read from the recording medium A second decoding step of performing a non-predictive decoding that, the saw including an output control step of outputting the picture in the display order obtained by the prediction decoding and the non-predictive decoding, the first decoding step, as the prediction decoding The MPEG decoding corresponding to the MPEG encoding is performed, and the playback device has recording means for recording a DCT coefficient obtained in the middle of the MPEG decoding, and the second decoding step is performed as the non-predictive decoding. Performing the intra decoding using the inverse of the wavelet transform, and the output control step outputs the DCT coefficients recorded in the recording means in the display order when the picture obtained by the MPEG decoding is output. To decrypt and output.

In the playback device or the playback method according to the third aspect as described above, a scene that is a set of similar series of pictures is detected from the moving image data including a plurality of pictures, and the scene is configured. When encoding a picture included in the scene with one of predictive coding and non-predictive coding representing coding different from the predictive coding for each scene based on an inter-picture difference value of each picture And the scene for which the predictive coding is selected as the coding method of the picture based on image information used to group the scenes into similar groups of pictures. One or more similar scenes are grouped into one group, and for each of the groups, the pre-set for the pictures constituting the group. As coded, for the picture included in the scene where the first encoded data obtained, and the non-prediction coding as the coding method of the picture is selected by performing MPEG encoding, the non As the predictive encoding, the first and second encoded data are decoded in the decoding order from the recording medium on which the second encoded data obtained by performing the intra encoding using the wavelet transform is recorded. The first encoded data and the second encoded data are read out, and for each group, the predictive decoding corresponding to the predictive encoding is performed on the first encoded data read from the recording medium. Non-predictive decoding corresponding to the non-predictive encoding is performed on the second encoded data read from the recording medium, and the prediction decoding and the non-predictive decoding are performed. Picture obtained Te is output to the display order. Note that, as the predictive decoding, MPEG decoding corresponding to the MPEG encoding is performed, and as the non-predictive decoding, intra decoding using inverse transformation of the wavelet transform is performed, and a picture obtained by the MPEG decoding is output. In this case, DCT coefficients obtained in the middle of the MPEG decoding are decoded into the picture and output in the display order.

  According to the present invention, it is possible to improve the compression rate while suppressing deterioration of the image of the moving image data.

  Embodiments of the present invention will be described below. Correspondences between the constituent elements of the present invention and the embodiments described in the specification or the drawings are exemplified as follows. This description is intended to confirm that the embodiments supporting the present invention are described in the specification or the drawings. Therefore, even if there is an embodiment which is described in the specification or the drawings but is not described here as an embodiment corresponding to the constituent elements of the present invention, that is not the case. It does not mean that the form does not correspond to the constituent requirements. Conversely, even if an embodiment is described here as corresponding to a configuration requirement, that means that the embodiment does not correspond to a configuration requirement other than the configuration requirement. It's not something to do.

The recording / reproducing apparatus according to the first aspect of the present invention (for example, the recording / reproducing apparatus 11 in FIG. 1) is a recording / reproducing apparatus for recording moving image data on a recording medium and reproducing the moving image data from the recording medium. Detection means (for example, the scene detection unit 41 in the image information creation unit 32 in FIG. 4) that detects a scene that is a set of similar series of pictures from the moving image data composed of a plurality of pictures, and the scene Based on the inter-picture difference value of each of the pictures constituting the image, for each scene, one of predictive coding and non-predictive coding representing coding different from the predictive coding is coded for a picture included in the scene. The selection means (for example, the encoder selection unit 181 in FIG. 24) to select as the encoding method at the time of grouping, and the scenes are grouped into similar groups of pictures Acquisition means (for example, the image information creation unit 32 in FIG. 24) for acquiring the image information used for the image, and the scene in which the predictive coding is selected as the picture coding method based on the image information. Grouping means for grouping one or more similar scenes into one group (for example, the grouping unit 33 in FIG. 24), and for each group, the prediction code for the pictures constituting the group First encoding means (for example, the compression unit 34 in FIG. 24) that performs encoding, and the non-prediction for a picture included in the scene for which the non-predictive encoding is selected as the picture encoding method. Second encoding means for encoding (for example, the compression unit 182 in FIG. 24), first encoded data obtained by the predictive encoding, and obtained by the non-predictive encoding Recording control means (for example, the input / output interface 21 in FIG. 24) for recording the second encoded data on the recording medium, and the recording medium in the decoding order for decoding the first and second encoded data Read control means (for example, the input / output interface 201 in FIG. 28) for reading the first and second encoded data from the first encoded data read from the recording medium for each group. On the other hand, the first decoding means (for example, the decompression unit 112 in FIG. 28) that performs prediction decoding corresponding to the prediction encoding, and the second encoded data read from the recording medium, Second decoding means (for example, the decompression unit 202 in FIG. 28) that performs non-predictive decoding corresponding to the non-predictive encoding, and outputs the pictures obtained by the predictive decoding and the non-predictive decoding in the order of display. Output control means (e.g., the output control unit 114 of FIG. 28) and a said first encoding means, as the predictive coding, performs MPEG (Moving Picture Expert Group) encoding, the second code The encoding means performs intra encoding using wavelet transform as the non-predictive encoding, and the first decoding means performs MPEG decoding corresponding to the MPEG encoding as the predictive decoding, and the MPEG decoding Recording means (for example, the buffer 134 in FIG. 20) for recording DCT (Discrete Cosine Transform) coefficients obtained in the middle of the above, and the second decoding means uses the inverse transform of the wavelet transform as the non-predictive decoding. When the output control means outputs a picture obtained by MPEG decoding, the output control means decodes the DCT coefficients recorded in the recording means into the pictures in the display order. To help.

  The recording / reproducing apparatus according to the first aspect further includes a creating unit (for example, a reduced image creating unit 163 in FIG. 22) that creates a reduced image obtained by reducing the picture, and the obtaining unit uses the reduced image, The image information can be acquired.

The recording / reproducing apparatus of the first aspect can include a plurality of the first decoding means (for example, the decompression units 1121 to 112n in FIG. 18).

A recording / reproducing method according to a first aspect of the present invention includes a plurality of pictures in a recording / reproducing method of a recording / reproducing apparatus that records moving image data on a recording medium and reproduces the moving image data from the recording medium. A detection step (for example, step S21 in FIG. 12 in step S92 in FIG. 27) for detecting a scene that is a set of similar series of pictures from the moving image data, and a difference between pictures of each picture constituting the scene Based on the value, for each scene, one of predictive coding or non-predictive coding representing coding different from the predictive coding is selected as a coding method for coding a picture included in the scene. Selection step (eg, step S93 in FIG. 27) and the scene is used to group similar groups of pictures. An acquisition step (e.g., step S92 of FIG. 27) for acquiring image information, and one or more similar scenes in which the predictive encoding is selected as the encoding method of the picture based on the image information A grouping step (for example, step S95 in FIG. 27) for grouping the scenes into one group, and a first code for performing the predictive coding for the pictures constituting the group for each group And a second code for performing the non-predictive coding on a picture included in the scene for which the non-predictive coding is selected as the picture coding method. Step (for example, step S97 in FIG. 27), the first encoded data obtained by the predictive encoding, and the non-predictive encoding The recording control step for recording the second encoded data obtained on the recording medium (for example, step S98 in FIG. 27) and the recording order in the decoding order for decoding the first and second encoded data. A read control step for reading the first and second encoded data from the medium (for example, step S111 in FIG. 30), and the first encoded data read from the recording medium for each group The first decoding step (for example, step S113 in FIG. 30) for performing predictive decoding corresponding to the predictive encoding, and the second encoded data read from the recording medium A second decoding step (for example, step S114 in FIG. 30) for performing non-predictive decoding corresponding to predictive coding, and a pixel obtained by the predictive decoding and the non-predictive decoding. Output control step of outputting the feature in the display order (for example, step S116 in FIG. 30) and saw including a first encoding step, as the predictive coding, performs MPEG (Moving Picture Expert Group) encoding, The second encoding step performs intra encoding using wavelet transform as the non-predictive encoding, and the first decoding step performs MPEG decoding corresponding to the MPEG encoding as the predictive decoding. The recording / reproducing apparatus includes recording means (for example, a buffer 134 in FIG. 20) for recording DCT (Discrete Cosine Transform) coefficients obtained in the middle of the MPEG decoding, and the second decoding step includes: As non-predictive decoding, intra-decoding using the inverse transform of the wavelet transform is performed, and when the output control step outputs a picture obtained by the MPEG decoding, The DCT coefficients recorded in recording means, a display order, to output the decoded the picture.

The recording apparatus according to the second aspect of the present invention (for example, the recording apparatus 221 shown in FIG. 32) detects a scene that is a set of similar series of pictures from the moving image data including a plurality of pictures. (For example, the scene detection unit 41 in the image information creation unit 32 in FIG. 4) and the prediction encoding or the prediction encoding for each scene based on the inter-picture difference value of each picture constituting the scene. Selection means (for example, an encoder selection unit 181 in FIG. 24) for selecting one of non-predictive encodings representing different encodings as an encoding method for encoding a picture included in the scene, and the scene as a picture Acquisition means (for example, the image information creation unit 32 in FIG. 24) for acquiring image information used for grouping into similar groups, and based on the image information, Grouping means for grouping one or more similar scenes into one group, for example, the scene in which the predictive coding is selected as the picture coding method (for example, grouping unit 33 in FIG. 24) For each group, first encoding means (for example, the compression unit 34 in FIG. 24) that performs the predictive encoding on the pictures constituting the group, and the non-prediction as the picture encoding method Second encoding means (for example, the compression unit 182 in FIG. 24) that performs the non-predictive encoding on a picture included in the scene for which encoding has been selected, and a first encoding obtained by the predictive encoding. Recording control means (for example, the input / output interface 21 in FIG. 24) for recording the first encoded data and the second encoded data obtained by the non-predictive encoding on the recording medium. Wherein the first encoding means, as the predictive coding, performs MPEG encoding, the second coding means, as the non-predictive coding, performs intra coding using wavelet transform .

Recording apparatus of the second aspect, transmitting the first and second encoded data recorded on the recording medium, in addition to the apparatus for reproducing the moving image data (e.g., the reproducing apparatus 231 of FIG. 32) Transmission control means (for example, the transmission control unit 225 in FIG. 32) can be further provided.

A recording method according to a second aspect is a recording method of a recording apparatus that records moving image data on a recording medium, and detects a scene that is a set of similar pictures from the moving image data including a plurality of pictures. Predictive coding or predictive coding for each scene based on the detection step (for example, step S21 in FIG. 12 in step S92 in FIG. 27) and the inter-picture difference value of each picture constituting the scene. A selection step (for example, step S93 in FIG. 27) for selecting one of the non-predictive encodings representing different encodings as a coding method for encoding a picture included in the scene; Acquisition step (for example, step S92 in FIG. 27) for acquiring image information used for grouping into similar groups A grouping step of grouping one or more similar scenes into one group, wherein the prediction coding is selected as the picture coding method based on the image information. For example, step S95 in FIG. 27, a first encoding step (for example, step S96 in FIG. 27) for performing the predictive encoding on the pictures constituting the group, for each group, A second encoding step (for example, step S97 in FIG. 27) for performing the non-predictive encoding on a picture included in the scene for which the non-predictive encoding is selected as an encoding method; Recording the first encoded data obtained by the encoding and the second encoded data obtained by the non-predictive encoding on the recording medium Please step (e.g., step S98 of FIG. 27) and saw including a first encoding step, as the predictive coding, performs MPEG encoding, the second coding step, the non-prediction coding As an example, intra coding using wavelet transform is performed.

The playback device according to the third aspect of the present invention (for example, the playback device 231 in FIG. 32) detects a scene that is a set of similar series of pictures from the moving image data including a plurality of pictures, and Based on the inter-picture difference value of each picture constituting a scene, for each of the scenes, one of predictive coding or non-predictive coding representing coding different from the predictive coding is converted into a picture included in the scene. Selected as an encoding method for encoding, and based on image information used to group the scene into similar groups of pictures, the predictive encoding is selected as the encoding method of the picture One or more similar scenes are grouped into a group, and each group is preceded by a picture that constitutes the group. As predictive coding, for the picture included in the scene where the first encoded data obtained, and the non-prediction coding as the coding method of the picture is selected by performing MPEG encoding, wherein Decoding for decoding the first and second encoded data from a recording medium on which the second encoded data obtained by performing intra encoding using wavelet transform as non-predictive encoding is recorded Read control means for reading out the first and second encoded data (for example, the input / output interface 201 in FIG. 28) and the first encoded data read from the recording medium for each group in order. In contrast, first decoding means (for example, the decompression unit 112 in FIG. 28) that performs predictive decoding corresponding to the predictive encoding, and the second read from the recording medium A second decoding unit (for example, the decompressing unit 202 in FIG. 28) that performs non-predictive decoding corresponding to the non-predictive encoding on the encoded data, and a picture obtained by the predictive decoding and the non-predictive decoding. Output control means (for example, the output control unit 114 in FIG. 28) for outputting in the display order, and the first decoding means performs MPEG decoding corresponding to the MPEG encoding as the predictive decoding, and the MPEG decoding Recording means (for example, the buffer 134 in FIG. 20) for recording the DCT coefficient obtained in the middle of the second decoding means, and the second decoding means uses intra-decoding using inverse wavelet transform as the non-predictive decoding. The output control means, when outputting the picture obtained by the MPEG decoding, causes the DCT coefficients recorded in the recording means to be decoded and output to the picture in the display order. The

The reproduction apparatus of the third aspect is a reception control means (for example, the reception of FIG. 32) that receives the first and second encoded data transmitted from another apparatus (for example, the recording apparatus 221 of FIG. 32). A control unit 232), and the first and second encoded data received by the reception control means are recorded on the recording medium.

A playback method according to a third aspect of the present invention is a playback method for a playback device that plays back moving image data, and detects a scene that is a set of similar series of pictures from the moving image data composed of a plurality of pictures. Then, based on the inter-picture difference value of each picture constituting the scene, the scene includes one of predictive coding and non-predictive coding representing coding different from the predictive coding for each scene. Selected as the encoding method when encoding the picture to be encoded, and the predictive encoding is selected as the encoding method for the picture based on the image information used to group the scenes into similar groups of pictures The one or more similar scenes are grouped into one group, and the group is configured for each group. As the prediction encoding on puncturing, pictures included in the scene where the first encoded data obtained, and the non-prediction coding as the coding method of the picture is selected by performing MPEG encoding On the other hand, as the non-predictive encoding, the first and second encodings are performed from the recording medium on which the second encoded data obtained by performing intra encoding using wavelet transform is recorded. A read control step (for example, step S111 in FIG. 30) for reading out the first and second encoded data in a decoding order for decoding data, and the first read out from the recording medium for each group. A first decoding step (for example, step S113 in FIG. 30) for performing predictive decoding corresponding to the predictive encoding on the encoded data; and the recording medium A second decoding step (for example, step S114 of FIG. 30) for performing non-predictive decoding corresponding to the non-predictive encoding on the second encoded data read from output control step of outputting the picture obtained by the non-predictive decoding in the display order (for example, step S116 in FIG. 30) and saw including a first decoding step, as the prediction decoding, MPEG corresponding to the MPEG encoding The playback apparatus has recording means (for example, a buffer 134 in FIG. 20) for recording DCT coefficients obtained in the middle of the MPEG decoding, and the second decoding step is performed as the non-predictive decoding. Intra decoding using inverse wavelet transform is performed, and the output control step is configured to output the picture obtained by the MPEG decoding when the recording process is performed. The DCT coefficients recorded in, in the display order, to output the decoded the picture.

  Next, embodiments of the present invention will be described with reference to the drawings.

  FIG. 1 is a block diagram showing a configuration example of an embodiment of a recording / reproducing system to which the present invention is applied.

  The recording / reproducing system includes a recording / reproducing apparatus 11, an HDTV (High Definition TeleVision) camera 12, and a monitor 16. The recording / reproducing apparatus 11 includes a recording control unit 13, a HDD (Hard Disk Drive) 14, and a reproduction control unit 15. Consists of. The recording / reproducing apparatus 11 can be applied to a hard disk recorder, a file server connected to a so-called home network, or the like.

  The HDTV camera 12 captures an HD (high resolution) moving image based on the HDTV signal and supplies it to the recording control unit 13.

  The recording control unit 13 supplies the HD moving image supplied from the HDTV camera 12 to the HDD 14 for recording. Further, the recording control unit 13 reads out the HD moving image recorded on the HDD 14 and groups each picture (frame or field) constituting the HD moving image into a group of similar pictures. Then, predictive encoding of the pictures constituting the group is performed, and the encoded data obtained as a result is supplied to the HDD 14 for recording.

  Here, when predictive coding of pictures as described above is performed, since the pictures constituting the group are similar to each other, prediction is performed in the arrangement order (display order) of pictures as they are as HD moving images from the HDD 14. Compared with the case of encoding, the compression rate can be improved. As a predictive encoding method, for example, there is an MPEG method. However, in the MPEG system, for example, predictive encoding is performed in units of GOP composed of 15 pictures or the like, but the recording control unit 13 performs predictive encoding in units of groups obtained by grouping described later. .

  The HDD 14 records an HD moving image supplied from the recording control unit 13 and encoded data obtained by encoding the HD moving image on the built-in hard disk. Note that a disk-shaped recording medium other than a hard disk, a semiconductor memory, or the like can be employed as a recording medium for recording a predictive-encoded HD moving image.

  The reproduction control unit 15 reads out the encoded data from the HDD 14 and decodes it, rearranges the pictures obtained as a result thereof in the display order, and supplies them to the monitor 16.

  The monitor 16 displays a picture supplied from the playback control unit 15, that is, an HD moving image.

  The recording control unit 13 can also record the HD moving image supplied from the HDTV camera 12 in the HDD 14 and then encode the HD moving image. Alternatively, the recording control unit 13 can directly record the HD moving image without recording in the HDD 14. The HD moving image supplied from the HDTV camera 12 can be encoded in real time.

  Here, in the recording / reproducing apparatus 11, as described above, HD moving picture pictures are grouped into groups of similar pictures, and predictive coding is performed in units of groups. Therefore, for a group that is a unit of predictive coding, for example, unlike an MPEG GOP, pictures are not necessarily arranged in the display order, and the number of pictures constituting the group is not necessarily constant. For this reason, even if, for example, encoding similar to MPEG that performs motion compensation and DCT conversion is adopted as the predictive encoding, a code obtained by performing predictive encoding in units of groups in the recording / reproducing apparatus 11 In order to reproduce the encoded data, the pictures are not necessarily arranged in the display order, and the number of pictures is not always constant, so a dedicated mechanism for decoding the encoded data of the group-unit picture is required. Become.

  Therefore, the encoded data obtained by the recording / reproducing apparatus 11 is recorded on, for example, an optical disk or other removable recording medium, and the encoded data recorded on the recording medium is recorded on a device different from the recording / reproducing apparatus 11. In order to reproduce, it is necessary that the other device has a dedicated mechanism for decoding the coded data of the group unit picture as described above.

  In MPEG, considering that editing and cueing (jump) are performed, a GOP is often composed of a small number of pictures such as 15 pictures. In FIG. 11, a group can be composed of a certain number of pictures without considering such editing and cueing.

  FIG. 2 is a block diagram illustrating a configuration example of the recording control unit 13 of FIG.

  The input / output interface 21 receives the HD moving image (data) supplied from the HDTV camera 12 and supplies it to the HDD 14 or the rearrangement compression unit 22. Further, the input / output interface 21 reads the HD moving image from the HDD 14 and supplies the HD moving image to the rearrangement compression unit 22. Further, the input / output interface 21 receives the encoded data of the HD moving image supplied from the rearrangement compression unit 22 and supplies it to the HDD 14 for recording.

  The rearrangement compression unit 22 groups the pictures constituting the HD moving image supplied from the HDTV camera 12 or the HDD 14 via the input / output interface 21 into groups of similar pictures, and sets the group for each group. Predictive coding of the constituent pictures is performed.

  In the recording control unit 13 configured as described above, the HD moving image supplied from the HDTV camera 12 is supplied to the input / output interface 21, and the input / output interface 21 converts the HD moving image from the HDTV camera 12 into the HDD 14. To be recorded.

  Thereafter, the input / output interface 21 reads the HD moving image from the HDD 14 and supplies the HD moving image to the rearrangement compression unit 22.

  The rearrangement compression unit 22 obtains image information by performing processing on the HD moving image supplied via the input / output interface 21, and groups the pictures of the HD moving image based on the image information. I do. Then, the rearrangement compression unit 22 performs predictive encoding of the pictures of the HD moving image in groups obtained by the grouping, and the encoded data obtained as a result is transferred to the HDD 14 via the input / output interface 21. Supply and record.

  Note that HD video (data) recorded on the HDD 14 from the HDTV camera 12 via the input / output interface 21 is required after the encoded data obtained by the rearrangement compression unit 22 is recorded on the HDD 14. Deleted accordingly.

  FIG. 3 is a block diagram illustrating a configuration example of the rearrangement compression unit 22 of FIG.

  The picture display number adding unit 31 adds a picture display number indicating the display order of pictures to each picture constituting the HD moving image supplied from the HDTV camera 12 or the HDD 14 via the input / output interface 21. Also, the picture display number adding unit 31 supplies each picture constituting the HD moving image to which the picture display number is added to the image information creating unit 32.

  The image information creating unit 32 uses each picture of the HD moving image supplied from the picture display number adding unit 31 to group the pictures constituting the HD moving image into similar picture groups. Create (acquire) information. Further, the image information creation unit 32 supplies the image information and each picture constituting the HD moving image to which the picture display number is added to the grouping unit 33.

  Using the image information supplied from the image information creation unit 32, the grouping unit 33 similarly groups each picture constituting the HD moving image supplied from the image information creation unit 32 into a group of similar pictures. Each picture constituting the HD moving image is supplied to the compression unit 34 in units of groups.

  The compression unit 34 regards the picture supplied from the grouping unit 33 in units of groups as 1 GOP, predictively encodes the pictures in the MPEG format, and obtains the group-unit encoded data obtained as a result via the input / output interface 21 on the HDD 14. To be recorded.

  FIG. 4 is a block diagram illustrating a configuration example of the image information creation unit 32 of FIG.

  The image information creation unit 32 includes a scene detection unit 41 and a histogram creation unit 42.

  The scene detection unit 41 detects a scene, which is a set of similar series of pictures, from the HD moving image supplied from the picture display number adding unit 31 (FIG. 3), and supplies it to the histogram creation unit 42.

  For each scene from the scene detection unit 41, the histogram creation unit 42 creates a histogram of pixel values of each picture constituting the scene. Further, for each scene, the histogram creation unit 42 obtains a histogram of the scene by taking the average of the pixel value histogram of each picture constituting the scene for each pixel value, and supplies it to the grouping unit 33 as image information. To do.

  For each scene from the scene detection unit 41, the histogram creation unit 42 obtains a histogram of a scene obtained by adding a pixel value histogram of each picture constituting the scene for each pixel value, as image information. It can also be.

  Here, in creating a histogram of pixel values, a luminance value or a color signal can be used as the pixel value.

  As the image information, information that can be used to determine whether the images are similar, such as a motion vector detected in units of blocks, in addition to a histogram of pixel values, can be employed.

  FIG. 5 is a block diagram illustrating a configuration example of the scene detection unit 41 in FIG.

  The scene detection unit 41 includes an inter-picture difference unit 51 and a scene division unit 52.

  The inter-picture difference unit 51 calculates the pixel values of the pixels at the same position of two adjacent pictures among the pictures arranged in the display order constituting the HD moving image supplied from the picture display number adding unit 31 (FIG. 3). The square sum of the differences is obtained as an inter-picture difference value and supplied to the scene dividing unit 52.

Specifically, for example, the Nth picture (picture display number) from the top of the HD moving image is the Nth picture, and the pixel values of the Nth picture are A ₁ , A ₂ ,. when expressed as _m, B _1, B ₂ pixel value of the (N + 1) picture in the raster scan order, ..., if it was decided to represent a B _m, first, inter-picture difference unit 51, a first N pictures For the corresponding (N + 1) -th picture, pixel value differences A ₁ −B ₁ , A ₂ −B ₂ ,..., A _m −B _m are taken for each corresponding pixel. Next, the inter-picture difference unit 51 squares the difference between the pixel values and adds (summations) the resulting values, thereby obtaining the inter-picture difference value (A + 1) of the (N + 1) th picture. ₁₋ B ₁ ) ² + (A ₂ −B ₂ ) ² +... + (A _m −B _m ) ² is acquired and supplied to the scene dividing unit 52.

  Note that the 0th picture does not actually exist, but for convenience, a picture having all pixel values of 0 is designated as the 0th picture, and the inter-picture difference value obtained from the 0th picture and the 1st picture is designated as the 0th picture. The difference value between pictures of one picture is assumed.

  Further, the inter-picture difference unit 51 divides each picture into blocks, obtains an average value (or motion vector) of pixel values for each block, and calculates an average value (or motion value) for each block at the same position in adjacent pictures. The sum of squares of the difference between the vectors may be used as the inter-picture difference value.

  Further, the inter-picture difference unit 51 creates a histogram of the pixel values of each picture, and calculates the absolute value or the sum of squares of the difference between the number of pixels (frequency) of each pixel value of the histogram of adjacent pictures. It can also be a difference value.

  The scene dividing unit 52 uses the inter-picture difference value of each picture supplied from the inter-picture difference unit 51 to divide each picture into scenes that are sets of similar series of pictures.

  That is, for example, when the inter-picture difference value of the Nth picture is less than a predetermined threshold, and the inter-picture difference value of the (N + 1) th picture that is the next picture exceeds the threshold, the scene dividing unit 52 detects the interval between the Nth picture and the (N + 1) th picture as a scene delimiter, and makes the Nth picture the last picture of the scene and the (N + 1) th picture as the next picture This is the first picture in the scene. Further, when the inter-picture difference value of the Nth picture exceeds the threshold value, and the inter-picture difference value of the next (N + 1) th picture is less than the threshold value, the scene dividing unit 52 The (N-1) picture is detected as a scene break, and the (N-1) th picture is the last picture of the scene, and the Nth picture is the first picture of the next scene. . Then, the scene dividing unit 52 searches the HD moving image in the display order, and detects a series of pictures from the first picture of the scene to the last picture of the next appearing scene as one scene.

  Next, the process of the scene dividing unit 52 in FIG. 5 will be further described with reference to FIG.

  In FIG. 6, the ■ marks indicate the HD composed of the first scene from the beginning (hereinafter referred to as the first scene), the second scene, the third scene, the fourth scene, the fifth scene, the sixth scene, and the seventh scene. The inter-picture difference value of each picture of the moving image is shown.

  Here, the first scene, the third scene, the fifth scene, and the seventh scene are, for example, scenes where an announcer is speaking in a studio, and the second scene is, for example, a scene based on a still image of graphics. . The fourth scene is, for example, a relay scene with intense movement, and the sixth scene is a scene shot with a camera different from the first scene, the third scene, the fifth scene, and the seventh scene in a studio, for example. It is.

  Here, in FIG. 6, the first picture, the tenth picture, the fifteenth picture, the twenty-fifth picture, the thirty-sixth picture, the forty-fourth picture, and the forty-ninth picture are the first pictures in the scene.

  When the inter-picture difference value in FIG. 6 is supplied from the inter-picture difference unit 51, the scene division unit 52 in FIG. 5 uses the inter-picture difference value to generate the first picture, the tenth picture, the fifteenth picture, The 25th picture, the 36th picture, the 40th picture, and the 49th picture are detected as the head of the scene, and are divided into seven scenes of the first scene to the seventh scene.

  FIG. 7 is a diagram illustrating an example of processing in the histogram creation unit 42 of FIG.

FIG. 7 shows pictures 61 _{1 to} 61 _n (n is the number of pictures constituting the m-th scene) and pictures 61 ₁ constituting the m-th scene among the scenes supplied from the scene detection unit 41 (FIG. 4). to show the histogram 63 _m as 61 _n each histogram 62 ₁ to 62 _n and the image information of the m scene.

The histogram creation unit 42 (FIG. 4), for example, calculates the average value of the number of pixels A ₁ (x) in the pixel value x of the histogram 62 ₁ of the picture 61 _{1 to} the number of pixels A _n (x) in the pixel value x of the histogram 62 _n. B _m (x) = (A ₁ (x) + A ₂ (x) +... + A _n-1 (x) + A _n (x)) / n is obtained, and the number of pixels of the pixel value x of the histogram 63 _m A histogram 63 _m as image information of the m-th scene is created by performing (frequency) for all pixel values.

  Next, an example of processing in the grouping unit 33 in FIG. 3 will be described with reference to FIG.

  The grouping unit 33 uses the histogram as the image information of the scene from the image information creation unit 32 to obtain a similarity value representing the degree of similarity between the scenes. In other words, the grouping unit 33 sets the difference 2 between the number of pixels (frequency) of each pixel value of the histogram of the scene from the image information creation unit 32 for any two of the scenes constituting the HD moving image. The sum of products is obtained as a similarity value of the two scenes.

Here, the number of pixels at the pixel value x for the histogram of the first scene is B ₁ (x), and the number of pixels at the pixel value x for the histogram of the second scene is B ₂ (x). If the pixel value x is an integer between 1 and 100, the similarity value between the first scene and the second scene is (B ₁ (1) −B ₂ (1)) ² + (B ₁ (2) −B ₂ (2)) ² +... + (B ₁ (99) −B ₂ (99)) ² + (B ₁ (100) −B ₂ (100)) ²

  FIG. 8 shows a case where the HD moving image to be grouped by the grouping unit 33 (FIG. 3) is composed of, for example, seven scenes from the first scene to the seventh scene as described in FIG. The similarity values of any two scenes are shown in tabular form.

  For example, assuming that scenes having a similarity value of 10 or less are similar scenes and are grouped into the same group, in FIG. 8, the first scene is the third scene, the fifth scene, Since the similarity value with the seventh scene is 10 or less, the grouping unit 33 is grouped into one group together with the third scene, the fifth scene, and the seventh scene.

  Next, the grouping unit 33 groups the second scenes that are not grouped by comparing similar values of the fourth scene and the sixth scene that are also not grouped. Specifically, the similarity value between the second scene and the fourth scene is 130, and the similarity value between the second scene and the sixth scene is 100, and none of them is 10 or less. Only two scenes are grouped into one group.

  Similarly, the fourth scene and the sixth scene are also grouped.

  As described above, the grouping unit 33 selects an arbitrary scene that is not grouped, detects an ungrouped scene whose similarity value with the arbitrary scene is equal to or less than a predetermined threshold, Arbitrary scenes and scenes detected for the arbitrary scenes are set as one group. The grouping unit 33 repeats the same processing until all scenes constituting the HD moving image are grouped into any group.

  Next, processing in the grouping unit 33 and the compression unit 34 in FIG. 3 will be further described with reference to FIG.

  9 shows HD moving image data (upper side of FIG. 9) composed of the first to seventh scenes, and HD moving image data (lower side of FIG. 9) after the scenes are grouped by the grouping unit 33. Is shown.

  In FIG. 9, the first scene, the third scene, the fifth scene, and the seventh scene are in one group G1, the second scene and the fourth scene are in another group G2, and only the sixth scene is further added. Each of the other groups G3 is grouped.

  The grouping unit 33 (FIG. 3) supplies the grouped scenes to the compression unit 34 in units of groups. The scenes are supplied in units of groups in the display order, that is, pictures with smaller picture display numbers. Is performed in the order of the group to which the scene including In FIG. 9, the picture display number of the picture included in the first scene belonging to the group G1 is the smallest, the picture display number of the picture included in the second scene belonging to the group G2 is the next smallest, and the sixth display belonging to the group G3. Since the picture display number of the picture included in the scene is the largest, the first scene, the third scene, the fifth scene, and the seventh scene belonging to the group G1, the second scene and the fourth scene belonging to the group G2, and the group G3 The sixth scene to which it belongs belongs to the compression unit 34 from the grouping unit 33 in that order.

  Then, the compression unit 34 regards one group as 1 GOP and MPEG-encodes the pictures constituting the scene belonging to each group.

  As described above, the compression unit 34 performs encoding by regarding a group as a GOP, and each group is composed of similar scenes (pictures). Compared with the case where the picture is encoded as GOP, the compression rate can be improved while suppressing the deterioration of the image quality.

  FIG. 10 shows a format of encoded picture data output from the compression unit 34 of FIG.

  The encoded data format of a picture is configured by adding a picture display number indicating the display order of the picture to the encoded data of the picture obtained by predictively encoding the picture.

  Next, processing in the rearrangement compression unit 22 in FIG. 3 will be described with reference to the flowchart in FIG. 11.

  For example, the rearrangement compression unit 22 performs processing according to the flowchart of FIG. 11 when the user operates an operation unit (not shown) or when there is (almost) no processing to be performed.

  That is, the input / output interface 21 reads the HD moving image from the HDD 14 and supplies it to the picture display number adding unit 31. In step S 11, the picture display number adding unit 31 adds a picture display number indicating the display order of the picture to each picture of the HD moving image supplied from the input / output interface 21, and supplies it to the image information creating unit 32. Then, the process proceeds to step S12.

  In step S12, the image information creation unit 32 uses the HD moving image supplied from the picture display number adding unit 31 to group the pictures constituting the HD moving image into similar picture groups. Create information. In addition, the image information creation unit 32 supplies the HD moving image and the image information to the grouping unit 33, and the process proceeds from step S12 to step S13.

  In step S <b> 13, the grouping unit 33 uses the image information supplied from the image information creation unit 32, and similarly converts each picture constituting the HD moving image supplied from the image information creation unit 32 to a group of similar pictures. The grouped pictures obtained as a result are supplied to the compression unit 34 in units of groups, and the process proceeds to step S14.

  In step S14, the compression unit 34 predictively encodes the grouped pictures supplied from the grouping unit 33 for each group, and supplies the encoded data obtained as a result to the input / output interface 21. Proceed to

In step S <b> 15, the input / output interface 21 supplies the encoded data supplied from the compression unit 34 to the HDD 14 for recording, and ends the process.

  Next, details of the image information creation processing in step S12 of FIG. 11 will be described with reference to the flowchart of FIG.

  In step S21, the scene detection unit 41 (FIG. 4) detects (calculates) a scene from the HD image supplied from the picture display number adding unit 31 (FIG. 3), and supplies it to the histogram creation unit 42 (FIG. 4). Then, the process proceeds to step S22.

  In step S22, the histogram creation unit 42 creates a histogram (FIG. 7) of each scene supplied from the scene detection unit 41, supplies it as image information to the grouping unit 33, and ends the process.

  Next, details of the scene detection process in step S21 in FIG. 12 will be described with reference to the flowchart in FIG.

  In step S31, the inter-picture difference unit 51 (FIG. 5) obtains an inter-picture difference value from each picture constituting the HD moving image supplied from the picture display number adding unit 31 (FIG. 3), and adds the picture display number. The HD moving image supplied from the unit 31 is supplied to the scene dividing unit 52 (FIG. 5), and the process proceeds to step S32.

  In step S32, the scene dividing unit 52 divides the HD moving image supplied from the inter-picture difference unit 51 into scenes using the inter-picture difference value supplied from the inter-picture difference unit 51, and the scene. The divided HD moving image is supplied to the histogram creating unit 42 (FIG. 4), and the process is terminated.

  Next, details of the grouping process in step S13 in FIG. 11 will be described with reference to the flowchart in FIG.

  In step S41, the grouping unit 33 (FIG. 3) selects, for example, one of the scenes that include the picture with the smallest picture display number and does not belong to any group from among the scenes constituting the HD moving image. Are selected as comparison scenes, and the process proceeds to step S42.

  In step S42, the grouping unit 33 determines whether there is a scene (hereinafter simply referred to as another scene) that is different from the comparison scene that is not grouped (does not belong to the group). If it is determined that it does not exist, the process proceeds to step S43. In step S43, the grouping unit 33 groups only the comparison scenes into one group.

On the other hand, when the grouping unit 33 determines in step S42 that another scene exists, the process proceeds to step S44, where the grouping unit 33 selects one of the other scenes as a target scene, and the image information creation unit Similarly, the histogram of the comparison scene from 32 and the histogram of the scene of interest from the image information creation unit 32 are obtained, and the process proceeds to step S45.

  In step S45, the grouping unit 33 determines whether or not the similarity value between the histogram of the comparison scene and the histogram of the target scene is equal to or less than a predetermined threshold value.

  If it is determined in step S45 that the similarity value is equal to or smaller than the predetermined threshold value, the process proceeds to step S46, and the grouping unit 33 sets the target scene as a grouping target that is grouped into the same group as the comparison scene, and step S47. Proceed to

  If it is determined in step S45 that the similarity value is not less than or equal to the predetermined threshold value, step S46 is skipped and the process proceeds to step S47, where the grouping unit 33 does not compare the similarity with the comparison scene. It is determined whether or not a scene exists, and when it is determined that such another scene exists, the process returns to step S44, and thereafter the same processing is repeated.

  On the other hand, if it is determined in step S47 that there is no other scene that has not been compared with the comparison scene, the process proceeds to step S48, and the grouping unit 33 is grouped into the same group as the comparison scene. All other scenes to be divided and comparison scenes are grouped into one group, and the process proceeds to step S49.

  In step S49, the grouping unit 33 determines whether all scenes are grouped. If it is determined that there is a scene that has not been grouped yet, the grouping unit 33 returns to step S41 and repeats the same processing. If it is determined that all scenes are grouped, the process ends.

  Note that the predetermined threshold value to be compared with the similar value in step S45 may be, for example, an arbitrary value determined by the user, or may be a value set in the recording control unit 13 in advance.

  FIG. 15 is a block diagram illustrating a configuration example of the reproduction control unit 15 of FIG.

  The playback control unit 15 includes an input / output interface 111, a decompression unit 112, a buffer 113, and an output control unit 114.

  The input / output interface 111 reads out encoded data of pictures (including scenes) from the HDD 14 in the order of decoding, and supplies them to the decompression unit 112. The input / output interface 111 reads out from the HDD 14 the encoded data of the group including (the encoded data of) the picture with the smaller picture display number as the encoded data of the group to be decoded earlier.

  The decompression unit 112 decodes the group-unit encoded data supplied from the input / output interface 111 as 1 GOP by the MPEG method, and sequentially stores each picture constituting the HD moving image obtained as a result in the buffer 113. Supply.

  The buffer 113 temporarily stores pictures constituting the HD moving image supplied from the decompression unit 112.

  The output control unit 114 reads the pictures stored in the buffer 113 in ascending order of the picture display numbers, thereby rearranging the arrangement of the pictures in the display order, and outputs and displays the pictures on the monitor 16.

  FIG. 16 is a diagram for explaining the order of reading the encoded data of the scene (the picture constituting it) from the HDD 14 by the input / output interface 111 and the order of reading the picture from the buffer 113 by the output control unit 114.

  In FIG. 16, the horizontal axis represents the time axis. Further, as described in FIG. 6, for example, the HD moving image is composed of seven scenes of the first scene to the seventh scene, and the first scene to the seventh scene are described in FIG. 9, for example. Thus, it is assumed that the group is divided into three groups, group G1, group G2, and group G3. That is, the first scene, the third scene, the fifth scene, and the seventh scene belong to the group G1, the second scene and the fourth scene belong to the group G2, and the sixth scene belongs to the group G3.

  Decoding of the encoded data needs to be performed first for pictures that are earlier in display order (temporally earlier). Therefore, as described above, the input / output interface 111 first reads out a group including a picture (with encoded data) having a smaller picture display number from the HDD 14 and supplies the group to the decompression unit 112.

  Therefore, as described with reference to FIG. 9, the group G1, the group G2, and the group G3 have the smallest picture display number of the picture included in the first scene belonging to the group G1, and are included in the second scene belonging to the group G2. Since the picture display number of the picture to be displayed is the next smallest and the picture display number of the picture included in the sixth scene belonging to the group G3 is the largest, the input / output interface 111 has the groups G1 and G2 as shown in the upper part of FIG. The encoded data is read from the HDD 14 in the order of the group G3 and supplied to the decompression unit 112.

  The decompressing unit 112 sequentially decodes the encoded data supplied from the input / output interface 111 in units of groups, and supplies the decoded data to the buffer 113 for storage. Then, the output control unit 114 reads out the pictures stored in the buffer 113 in ascending order of picture display numbers, that is, in the order of display, as shown in the lower side of FIG.

  Next, the processing in the reproduction control unit 15 in FIG. 15 will be described with reference to the flowchart in FIG.

  For example, when the user operates the operation unit (not shown) and the reproduction of the image is instructed to the input / output interface 111, the input / output interface 111 reads the picture (including scene) from the HDD 14 in step S81. The digitized data is read in the order of decoding in units of groups, supplied to the decompression unit 112, and the process proceeds to step S82. The input / output interface 111 reads out from the HDD 14 the encoded data of the group including (the encoded data of) the picture with the smaller picture display number as the encoded data of the group to be decoded earlier.

  In step S82, the decompression unit 112 decodes the group-unit encoded data supplied from the input / output interface 111 as 1 GOP according to the MPEG system, and sequentially selects each picture constituting the HD moving image obtained as a result. , The buffer 113 is supplied, and the process proceeds to step S83.

  In step S83, the buffer 113 temporarily stores the pictures constituting the HD moving image supplied from the decompression unit 112, and the process proceeds to step S84.

  In step S84, the output control unit 114 reads out the pictures stored in the buffer 113 in ascending order of the picture display numbers, thereby rearranging the arrangement of the pictures in the display order, and outputs and displays them on the monitor 16 for processing. finish.

  Next, in the playback control unit 15 of FIG. 15, the encoded data is decoded by one decompression unit 112. Depending on the processing speed at which one decompression unit 112 decodes a picture, Picture decoding may not be in time. Therefore, the playback control unit 15 can be configured using a plurality of thawing units configured in the same manner as the thawing unit 112.

  FIG. 18 is a block diagram illustrating a configuration example of the reproduction control unit 15 configured using a plurality of decompression units.

  In the figure, portions corresponding to those in FIG. 15 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

18 includes an input / output interface 121 instead of the input / output interface 111, and a plurality of decompression units 112 ₁ having the same configuration as the decompression unit 112 instead of the decompression unit 112. The configuration is the same as in the case of FIG. 15 except that through 112 _n are provided.

The input / output interface 121 reads the encoded data in units of groups from the HDD 14, similarly to the input / output interface 111 of FIG. 15. Then, the input / output interface 121 selects _one of the decompressing units 112 _{1 to} 112 _n that has not been decrypted (free), and the selected decompressing unit receives the group unit read from the HDD 14. Encoded data is supplied and decoded.

The decompression units 112 _{1 to} 112 _n decode the group-unit encoded data supplied from the input / output interface 121 as 1 GOP encoded data by the MPEG method, and supply the resulting picture to the buffer 113.

  The output control unit 114 reads the pictures stored in the buffer 113 in the display order as described with reference to FIG. As a result, the HD moving image is displayed on the monitor 16.

In the decompression unit 112 of FIG. 15, when the decoding of the encoded data recorded in the HDD 14 can be made in time for display, the decompression unit 112 uses each of the plurality of decompression units 112 _{1 to} 112 _n. A slow one can be used. Conversely, the decompression unit 112 in FIG. 15 needs to have a higher-speed decoder function than each of the plurality of decompression units 112 _{1 to} 112 _n .

  FIG. 19 is a block diagram illustrating another configuration example of the reproduction control unit 15 of FIG.

  In the figure, portions corresponding to those in FIG. 15 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the playback control unit 15 in FIG. 19 is configured in the same manner as in FIG. 15 except that a decompression unit 122 is provided instead of the decompression unit 112, the buffer 113, and the output control unit 114 in FIG. ing.

  The decompression unit 122 is supplied with encoded data that has been predictively encoded by the MPEG method from the input / output interface 111. Further, the decompression unit 122 decodes the encoded data supplied from the input / output interface 111 to DCT (Discrete Cosine Transform) coefficients, temporarily stores the resulting DCT coefficients, and stores them at an appropriate time. The obtained DCT coefficients are decoded into pictures in the display order and supplied to the monitor 16.

  FIG. 20 is a block diagram showing a configuration of the decompression unit 122 of FIG.

  The buffer 131 temporarily stores the encoded data (variable length code) supplied from the input / output interface 111 and supplies it to the variable length decoding unit 132 as needed.

  The variable length decoding unit 132 decodes the variable length code supplied from the buffer 131, obtains a quantization coefficient (a value obtained by quantizing the DCT coefficient) and a motion vector, and supplies this to the inverse quantization unit 133.

  The inverse quantization unit 133 inversely quantizes the quantization coefficient supplied from the variable length decoding unit 132 and converts it into a DCT coefficient. Further, the inverse quantization unit 133 supplies the DCT coefficient and the motion vector supplied from the variable length decoding unit 132 to the buffer 134 to be stored.

  The buffer 134 temporarily stores the DCT coefficient and the motion vector supplied from the inverse quantization unit 133. As a recording medium serving as a buffer 134 for temporarily storing the DCT coefficients and motion vectors supplied from the inverse quantization unit 133, for example, a semiconductor memory or a hard disk built in the HDD 14 can be employed. .

  The output control unit 135 reads the DCT coefficients and motion vectors necessary for decoding the pictures stored in the buffer 134 in the picture display order, supplies the DCT coefficients to the inverse DCT unit 136, and moves the motion vectors. It supplies to the compensation part 139.

  The inverse DCT unit 136 performs an inverse DCT process on the DCT coefficient supplied from the output control unit 135 and supplies a pixel value obtained as a result to the calculation unit 137.

  When the pixel value from the inverse DCT unit 136 is a pixel value of an I (Intra) picture, the calculation unit 137 outputs the pixel value as it is as a decoding result of the picture, and the pixel value from the inverse DCT unit 136 is P ( If the pixel value is a pixel value of a (Predictive) picture or a B (Bidirectionally) picture, the pixel value of the predicted image supplied from the motion compensation unit 139 is added, and the resultant addition value is output as a decoding result of the picture.

  The buffer 138 stores an I picture and a P picture that are referred to for generating a predicted image used for decoding a P picture or a B picture among the decoding results (pictures) output from the arithmetic unit 137.

  The motion compensation unit 139 refers to the picture stored in the buffer 138, performs motion compensation using the motion vector supplied from the output control unit 135, and supplies the predicted image obtained as a result to the calculation unit 137.

  In the decompression unit 122 configured as described above, encoded data of a picture supplied in units of blocks from the input / output interface 111 is processed by the buffer 131, the variable length decoding unit 132, and the inverse quantization unit 133. The DCT coefficient and motion vector of each picture obtained by the above are supplied to the buffer 134 and stored together with the picture display number of the picture.

  Then, the output control unit 135 reads the DCT coefficient and motion vector of each picture stored in the buffer 134 in ascending order of the picture display number, that is, the display order of the picture, and moves the DCT coefficient to the inverse DCT unit 136. The vectors are supplied to the motion compensation unit 139, respectively. As a result, the inverse DCT unit 136, the calculation unit 137, the buffer 138, and the motion compensation unit 139 use the DCT coefficient and the motion vector of each picture to decode and output each picture (pixel value thereof) in the display order. Is done.

  Note that the decompression unit 122 stores the encoded data supplied from the input / output interface 111 in the buffer 134 in the state of the DCT coefficient obtained in the middle of decoding, so that the buffer in the state of the HD moving image after decoding. Compared with the case of saving in the buffer 113 (for example, the buffer 113 in FIG. 15), the storage capacity of the buffer can be further saved.

  Next, in the playback control unit 15 of FIG. 19, the encoded data is decoded by one decompression unit 122. Depending on the processing speed at which one decompression unit 122 decodes a picture, Picture decoding may not be in time. Therefore, the playback control unit 15 can be configured using a plurality of thawing units configured in the same manner as the thawing unit 122.

  FIG. 21 is a block diagram illustrating another configuration example of the reproduction control unit 15 configured using a plurality of decompression units.

The playback control unit 15 in FIG. 21 includes an input / output interface 121 described with reference to FIG. 18 and a plurality of decompression units 122 _{1 to} 122 _n having the same configuration as the decompression unit 122 described with reference to FIGS. 19 and 20. Yes.

In the reproduction control unit 15 of FIG. 21, the input / output interface 121 reads out encoded data in units of groups from the HDD 14. Then, the input / output interface 121 selects one of the plurality of decompressing units 122 _{1 to} 122 _n that has not been decoded, and supplies encoded data in units of groups to the selected decompressing unit. Decrypt.

Similarly to the decompression unit 122 in FIG. 19, each decompression unit 122 _{1 to} 122 _n decodes the encoded data supplied from the input / output interface 121 up to the DCT coefficient, and buffers the resulting DCT coefficient (FIG. 20). In the buffer corresponding to the buffer 134). Further, each decompression unit 122 _{1 to} 122 _n decodes the DCT coefficient of each picture stored in the buffer into a picture immediately before the display timing of the picture and outputs it to the monitor 16 at an appropriate time.

  FIG. 22 is a block diagram showing another configuration example of the recording control unit 13 of FIG.

  In the figure, portions corresponding to those in FIG. 2 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the recording control unit 13 in FIG. 22 is the same as in the case of FIG. 2 except that a compression unit 161, a decompression unit 162, a reduced image creation unit 163, an intra compression unit 164, and an intra decompression unit 165 are newly provided. It is constituted similarly.

  The compression unit 161 encodes an HD moving image supplied from the HDTV camera 12 via the input / output interface 21 using, for example, a lossless encoding method (compression method). That is, in FIG. 2, the HD moving image from the HDTV camera 12 is recorded on the HDD 14 without being encoded, but in FIG. 22, the HD moving image from the HDTV camera 12 is encoded by the compression unit 161. The data amount can be reduced and recorded on the HDD 14.

  The decompression unit 162 reads the encoded data recorded by the compression unit 161 recorded in the HDD 14 from the HDD 14 via the input / output interface 21 and decodes it by a decoding method according to the encoding method by the compression unit 161. Then, the resulting HD moving image is supplied to the input / output interface 21.

  The reduced image creation unit 163 creates a reduced image by thinning out the number of pixels of each picture of the HD moving image supplied from the HDTV camera 12 via the input / output interface 21 and supplies the reduced image to the input / output interface 21.

  The intra compression unit 164 intra-codes the reduced image supplied from the input / output interface 21 and supplies the reduced image to the HDD 14 for recording.

  The intra decompression unit 165 decodes intra-encoded data obtained by intra-encoding the reduced image of each picture supplied from the input / output interface 21, and supplies the reduced image obtained as a result to the input / output interface 21.

  In the recording control unit 13 configured as described above, the HD moving image supplied from the HDTV camera 12 is supplied to the input / output interface 21, and the input / output interface 21 compresses the HD moving image from the HDTV camera 12. To the unit 161 and the reduced image creation unit 163. The compression unit 161 encodes the HD moving image from the input / output interface 21 and supplies the encoded data obtained as a result to the input / output interface 21. The input / output interface 21 supplies the encoded data from the compression unit 161 to the HDD 14, whereby the encoded data of the HD moving image is recorded by the HDD 14.

  The reduced image creation unit 163 creates a reduced image of each picture of the HD moving image from the input / output interface 21 and supplies the reduced image to the intra compression unit 164 via the input / output interface 21. The intra compression unit 164 intra-codes the reduced image supplied via the input / output interface 21 and supplies the intra-encoded data obtained as a result to the input / output interface 21. The input / output interface 21 supplies the intra-encoded data from the intra-compression unit 164 to the HDD 14, whereby the intra-encoded data of the reduced image is recorded by the HDD 14.

  Thereafter, the input / output interface 21 reads out the encoded data of the HD moving image and the intra-encoded data of the reduced image from the HDD 14, supplies the encoded data of the HD moving image to the decompression unit 162, and The intra-coded data is supplied to the intra decompression unit 165.

  The decompression unit 162 decodes the encoded data from the input / output interface 21 into each picture of the original HD moving image and supplies the decoded data to the rearrangement compression unit 22 via the input / output interface 21. Further, the intra decompression unit 165 decodes the intra-encoded data from the input / output interface 21 into the original reduced image, and supplies it to the rearrangement compression unit 22 via the input / output interface 21.

  The rearrangement compression unit 22 obtains image information by performing processing on a reduced image supplied via the input / output interface 21, and supplies the image information based on the image information via the input / output interface 21. Group each picture of HD video. Then, the rearrangement compression unit 22 performs predictive encoding of the pictures of the HD moving image in groups obtained by the grouping, and the encoded data obtained as a result is transferred to the HDD 14 via the input / output interface 21. Supply and record.

  The encoded data obtained by the compression unit 161 recorded on the HDD 14 is deleted as necessary after the encoded data obtained by the rearrangement compression unit 22 is recorded on the HDD 14.

  FIG. 23 is a block diagram illustrating a configuration example of the reduced image creation unit 163 of FIG.

  The reduced image creation unit 163 includes an LPF (Low-Pass Filter) 171 and a downsampling unit 172. The reduced image creating unit 163 removes the high frequency band component of the HD moving image supplied from the HDTV camera 12 via the input / output interface 21 in the LPF 171, and further, in the downsampling unit 172, each picture of the HD moving image By reducing the number of pixels, a reduced image obtained by reducing each picture is supplied to the input / output interface 21.

  FIG. 24 is a block diagram illustrating another configuration example of the rearrangement compression unit 22 of FIG.

  In the figure, parts corresponding to those in FIG. 3 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the rearrangement compression unit 22 in FIG. 24 is configured in the same manner as in FIG. 3 except that an encoder selection unit 181 and a compression unit 182 are newly provided. However, in FIG. 3, the image information creation unit 32 outputs the pictures constituting the HD moving image and the image information (histogram) of the scene, but in FIG. 24, the image information creation unit 32 In addition to the pictures constituting the HD moving image and the image information of the scene, the inter-picture difference value of each picture is also output.

  The encoder selection unit 181 is supplied with each picture constituting the HD moving image, an inter-picture difference value of each picture constituting the HD moving image, and image information output from the image information creation unit 32. Yes. Similarly, the encoder selection unit 181 uses the inter-picture difference value of each picture constituting the HD moving image supplied from the image information creation unit 32 to each of the HD moving images supplied from the image information creation unit 32. A picture coding method is selected for each scene, information on the selected coding method is added to each picture included in the scene, and pictures are grouped by scene according to the coding method. Or supplied to the compression unit 182.

  That is, the encoder selection unit 181 determines, for example, whether or not there are a predetermined number or more of pictures having a certain difference value or more between pictures constituting the HD moving image. Scenes determined to have a predetermined number or more of pictures with a certain difference value or more are classified as scenes with intense motion (scenes with many dissimilar pictures). Further, the encoder selection unit 181 selects to perform coding in the subsequent compression unit 182 for a scene classified as a scene with intense motion, and is a scene that has not been classified into a scene with intense motion, that is, motion For a scene with no (almost) no (a scene with few similar pictures), it is selected to perform predictive coding in the compression unit 34 (FIG. 3). Then, the encoder selection unit 181 adds, for example, information that predictive encoding is performed by the MPEG encoding method to the picture that configures the scene that is selected by the compression unit 34, and together with the image information of the scene, This is supplied to the grouping unit 33. In addition, the encoder selection unit 181 adds, for example, information that is encoded by wavelet transform to the picture that configures the scene selected for encoding by the compression unit 182, and the scene (the picture that configures the scene) Supply to the compression unit 182.

  The compression unit 182 performs wavelet transform on the scene picture supplied from the encoder selection unit 181, that is, the scene picture having a certain level of motion, and supplies the encoded data obtained as a result to the input / output interface 21. .

  Note that the rearrangement compression unit 22 in FIG. 24 can employ a configuration in which the processing of the grouping unit 33 is performed before the processing of the encoder selection unit 181.

  That is, in FIG. 24, the grouping unit 33 is provided between the encoder selection unit 181 and the compression unit 34, but the grouping unit 33 is not between the encoder selection unit 181 and the compression unit 34, but the image information It can be provided between the creation unit 32 and the encoder selection unit 181. In this case, the encoder selection unit 181 selects which of the compression unit 34 and the compression unit 182 encodes a picture in units of groups, not in units of scenes.

  The compression unit 182 performs wavelet transform, which is one of the encodings different from the predictive encoding performed by the compression unit 34. However, the encoding performed by the compression unit 182 is not limited to wavelet transform. Absent. In other words, the encoding unit 182 can employ any encoding as long as it encodes a picture intra-encoding. However, in particular, it is desirable to use intra coding with low image quality degradation and a high compression rate.

  In the case where the compression unit 34 and the compression unit 182 perform encoding on an HD moving image already recorded in the HDD 14, the encoding on the HD moving image supplied in real time from the HDTV camera 12 is performed. Unlike the compression unit 34 and the compression unit 182, the other encoding process can be performed after the end of the encoding process of the compression unit 34 and the compression unit 182, or both of the encoding processes can be performed in parallel.

  Next, processing in the grouping unit 33, the compression unit 34, the encoder selection unit 181 and the compression unit 182 in FIG. 24 will be further described with reference to FIG.

  Now, for example, as shown first in FIG. 25 from the top in FIG. 25, the HD moving image is composed of the first scene to the seventh scene, and the first scene, the third scene, the fifth scene, and the seventh scene are mutually connected. Although similar, it is assumed that the second scene, the fourth scene, and the sixth scene are not similar to other scenes. Furthermore, the fourth scene is a scene with a lot of movement, but the other scenes, that is, the first scene to the third scene and the fifth scene to the seventh scene are all similar in that there is (almost) no movement. Suppose that it is a scene.

  In this case, the encoder selection unit 181 selects the encoding by the compression unit 182 for the fourth scene, which is a scene with intense motion, and the fourth scene is supplied from the encoder selection unit 181 to the compression unit 182. Further, the encoder selection unit 181 selects the encoding by the compression unit 34 for the first scene to the third scene and the fifth scene to the seventh scene, which are scenes without motion, and the first scene to the third scene. The fifth scene to the seventh scene are supplied from the encoder selection unit 181 to the grouping unit 33.

  Then, in the grouping unit 33, as shown second from the top in FIG. 25, the first scene to the third scene and the fifth scene to the seventh scene from the encoder selection unit 181 are similar to each other. , A group G1 composed of the third scene, the fifth scene, and the seventh scene, a group G2 composed of only the second scene, and a group G3 composed of only the sixth scene, and are supplied to the compression unit 34 in units of groups. The

  The compression unit 34 regards each of the group G1, the group G2, and the group G3 as 1 GOP, and performs predictive encoding by the MPEG method.

  On the other hand, in the compression unit 182, each picture of the fourth scene shown third from the top in FIG. 25 is wavelet transformed.

  Here, for pictures of scenes with intense motion, by performing wavelet transform, the degradation of image quality is reduced or the compression rate is improved compared to the case of performing predictive coding such as MPEG. Can do.

  FIG. 26 illustrates a format of encoded data of a picture output from the compression unit 34 or the compression unit 182 of FIG.

  The format of the encoded data of the picture represents the encoded data of the picture obtained by predictively encoding the picture or the picture data encoded by the wavelet transform obtained by wavelet transform, and the display order of the picture. A picture display number and information indicating the coding scheme of the picture are added to the picture display number.

  Next, processing in the rearrangement compression unit 22 in FIG. 24 will be described with reference to the flowchart in FIG.

  The rearrangement compression unit 22 performs processing according to the flowchart of FIG. 27 when, for example, the user operates an operation unit (not shown) or when there is (almost) no processing to be performed.

  That is, the input / output interface 21 reads the HD moving image from the HDD 14 and supplies it to the picture display number adding unit 31. In step S 91, the picture display number adding unit 31 adds a picture display number indicating the display order of the picture to each picture of the HD moving image supplied from the input / output interface 21, and supplies it to the image information creating unit 32. Then, the process proceeds to step S92.

  In step S92, the image information creation unit 32 obtains an inter-picture difference value of each picture of the HD moving image supplied from the picture display number adding unit 31, as in step S12 of FIG. Based on this, the scene of the HD moving image is detected. Further, the image information creation unit 32 creates image information used for grouping the pictures constituting the HD moving image into groups of similar pictures for each scene. Then, the image information creation unit 32 supplies each picture constituting the HD moving image, the image information of the scene, and the inter-picture difference value to the encoder selection unit 181, and proceeds from step S 92 to step S 93.

  In step S93, the encoder selection unit 181 uses the inter-picture difference value supplied from the image information creation unit 32, and similarly encodes each picture constituting the HD moving image supplied from the image information creation unit 32. Is selected for each scene, and information relating to the selected encoding method is added to a picture included in the scene. The encoder selection unit 181 supplies the scene (the picture constituting the scene) selected by the compression unit 34 together with the image information of the scene supplied from the image information creation unit 32 to the grouping unit 33, and the compression unit The scene selected for encoding in 182 is supplied to the compression unit 182 and the process proceeds to step S94.

  In step S94, processing for the pictures constituting the scene supplied from the encoder selection unit 181 is performed. That is, in step S94, the grouping unit 33 is supplied from the encoder selection unit 181 in the same manner as in step S13 of FIG. 11 using the image information of the scene supplied from the encoder selection unit 181 in step S95. The pictures constituting the scene are grouped in units of scenes, and the resulting grouped scenes (pictures constituting the groups) are supplied to the compression unit 34 in units of groups, and the process proceeds to step S96.

  In step S <b> 96, the compression unit 34 predictively encodes the picture supplied from the grouping unit 33 by the MPEG method in units of groups, and supplies the encoded data obtained as a result to the input / output interface 21.

  On the other hand, in step S97, the compression unit 182 performs wavelet transform on each picture constituting the scene supplied from the encoder selection unit 181 and supplies the encoded data obtained as a result to the input / output interface 21.

  After the process of step S94, the process proceeds to step S98, and the input / output interface 21 supplies the encoded data supplied from the compression unit 34 or the compression unit 182 to the HDD 14 and records it, and ends the process.

  In step S92, the image information creation unit 32 uses the reduced image of the HD moving image created by the reduced image creation unit 163 (FIG. 22) to make the pictures constituting the HD moving image into similar picture groups. Image information used for grouping may be created.

  FIG. 28 is a block diagram showing a configuration example of the reproduction control unit 15 in FIG. 1 when the recording control unit 13 in FIG. 1 is configured as shown in FIG.

  In the figure, portions corresponding to those in FIG. 15 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  That is, the playback control unit 15 of FIG. 28 is provided with an input / output interface 201 instead of the input / output interface 111 of FIG. 15, and further, a decompression unit 202 is newly provided. The configuration is the same as in the case.

  The input / output interface 201 reads out encoded data of pictures (including scenes) from the HDD 14 in the order to be decoded, and based on the information about the encoding method assigned to the encoded data, the decompression unit 112 or the decompression unit 202 To supply. That is, the input / output interface 201 supplies encoded data obtained by MPEG encoding to the decompression unit 112 and supplies encoded data obtained by wavelet transform to the decompression unit 202. The input / output interface 201 reads encoded data including a picture with a smaller picture display number from the HDD 14 as encoded data to be decoded earlier.

  The decompressing unit 202 decodes the wavelet-transformed encoded data supplied from the input / output interface 201 by performing inverse transform, and supplies each picture constituting the HD moving image obtained as a result to the buffer 113.

  FIG. 29 is a diagram for explaining the order of reading encoded data of a scene (pictures constituting the scene) from the HDD 14 by the input / output interface 201 of FIG. 28 and the order of reading pictures from the buffer 113 by the output control unit 114. It is.

  In FIG. 29, the horizontal axis represents the time axis. Also, as described in FIG. 25, for example, the HD moving image is composed of the first scene to the seventh scene, and the first scene, the third scene, the fifth scene, and the seventh scene are similar to each other, Assume that the second scene, the fourth scene, and the sixth scene are not similar to other scenes. Furthermore, the fourth scene is a scene with a lot of movement, but the other scenes, that is, the first scene to the third scene and the fifth scene to the seventh scene are all scenes with (almost) no movement. And In addition, only the group G1 and the second scene including the first scene, the third scene, the fifth scene, and the seventh scene in which the first to third scenes, the fifth scene, and the seventh scene are similar to each other. It is assumed that the group G2 is divided into a group G3 including only the sixth scene.

  Further, each of the group G1, the group G2, and the group G3 is regarded as 1 GOP, and is predicted-encoded by the MPEG method, and the encoded data obtained as a result is recorded in the HDD 14. To do. Furthermore, each picture of the fourth scene is wavelet transformed, and the encoded data obtained as a result is also recorded in the HDD 14.

  Here, the decoding of the encoded data needs to be performed first for pictures that are earlier in display order (temporally earlier). Therefore, as described above, the input / output interface 201 first reads a scene or group including (encoded data) of a picture with a smaller picture display number from the HDD 14 and decompresses it based on information on the encoding method. Supplied to the unit 112 or the decompression unit 202.

  Specifically, first, for the group G1, the group G2, the group G3, and the fourth scene, the picture display number of the picture included in the first scene belonging to the group G1 is the smallest, and the second scene belonging to the group G2 Since the picture display number of the picture included is the next smallest, the picture display number of the picture contained in the fourth scene is the next smallest, and the picture display number of the picture contained in the sixth scene belonging to the group G3 is the largest. The output interface 201 reads out from the HDD 14 in the order of the group G1, the group G2, the fourth scene, and the group G3, and the group G1, the group G1, and the group G1 are shown as the first and second from the top in FIG. Are supplied to the decompression unit 112, and the fourth scene is supplied to the decompression unit 202.

  The decompression unit 112 sequentially decodes the encoded data supplied from the input / output interface 201 in units of groups, and supplies the decoded data to the buffer 113 for storage. The decompressing unit 202 decodes the encoded data supplied from the input / output interface 201, supplies the decoded data to the buffer 113, and stores the decoded data.

  Then, the output control unit 114 reads out the pictures stored in the buffer 113 in the order from the smallest picture display number, that is, in the display order, as shown in the third from the top (first from the bottom) in FIG. To supply.

  Next, processing in the reproduction control unit 15 in FIG. 28 will be described with reference to the flowchart in FIG.

  For example, when the user operates the operation unit (not shown) and the reproduction of the image is instructed to the input / output interface 201, the input / output interface 201 reads the picture (including scene) from the HDD 14 in step S111. The data is read in the order of decoding in units of groups or scenes, supplied to the decompression unit 112 or the decompression unit 202, and the process proceeds to step S112.

  In step S112, the decompression unit 112 or the decompression unit 202 decodes the encoded data supplied from the input / output interface 201. That is, in step S112, the decompression unit 112 decodes the encoded data supplied in units of groups from the input / output interface 201 in step S113 by the MPEG system, and each picture constituting the HD moving image obtained as a result is decoded. Is supplied to the buffer 113.

  In step S114, the decompressing unit 202 decodes the encoded data supplied from the input / output interface 201 in units of scenes by inverse wavelet transform, and each picture constituting the HD moving image obtained as a result is decoded. , And supplied to the buffer 113.

  Thereafter, the process proceeds from step S112 to step S115, and the buffer 113 temporarily stores each picture constituting the HD moving image supplied from the decompression unit 112 and the decompression unit 202, and then proceeds to step S116.

  In step S116, the output control unit 114 reads out the pictures stored in the buffer 113 in ascending order of the picture display numbers, thereby rearranging the order of the pictures, outputting them to the monitor 16, and displaying them. finish.

  FIG. 31 is a block diagram showing still another configuration example of the reproduction control unit 15 in FIG.

  In the figure, portions corresponding to those in FIG. 21 are denoted by the same reference numerals, and description thereof will be omitted as appropriate.

  31 is provided with an input / output interface 211 instead of the input / output interface 121 of FIG. 21, and a decompression unit 202, a buffer 213, and an output control unit 214 are newly provided. Other than that, the configuration is the same as in the case of FIG.

The input / output interface 211 reads out the encoded data in units of groups or in units of scenes (not grouped) from the HDD 14. Then, the input / output interface 211 supplies the encoded data to the decompressing units 122 _{1 to} 122 _n or the decompressing unit 202 based on the encoding scheme added to the encoded data. That is, the input / output interface 211 selects one of the plurality of decompression units 122 _{1 to} 122 _n that has not been decoded, and supplies the selected unit to the selected decompression unit. Decrypt. Further, the input / output interface 211 supplies the decompression unit 202 with decoded data in units of scenes (not grouped) for decoding.

  Similarly to the decompression unit 202 of FIG. 28, the decompression unit 202 decodes the wavelet transformed encoded data supplied from the input / output interface 211 by performing inverse transform, and the resulting picture is stored in the buffer 213. Supply.

  The buffer 213 temporarily stores the picture supplied from the decompression unit 202.

  The output control unit 214 outputs the picture stored in the buffer 213 to the monitor 16 for display at an appropriate time.

  In FIG. 31, only one thawing unit 202 is provided, but the playback control unit 15 can be configured by providing a plurality of thawing units configured in the same manner as the thawing unit 202.

  FIG. 32 is a diagram showing a configuration example of another embodiment of a recording / reproducing system to which the present invention is applied. In the figure, portions corresponding to those in FIG. 1 are denoted by the same reference numerals.

  The recording / playback system includes an HDTV camera 12, a monitor 16, a recording device 221, and a playback device 231.

  The recording device 221 includes a recording control unit 223, an HDD 224, and a transmission control unit 225. The recording control unit 223 is configured similarly to the recording control unit 13 of FIG.

  The HDD 224 records the encoded data supplied from the recording control unit 223 and the like, like the HDD 14 in FIG.

  The transmission control unit 225 complies with, for example, the Internet, LAN (Local Area Network), IEEE (Institute of Electrical and Electronic Engineers) 1394, and USB (Universal Serial Bus) standards for the encoded data read from the HDD 224. Control transmission to the playback apparatus 231 via a network or the like.

  The playback device 231 includes a reception control unit 232, an HDD 233, and a playback control unit 234.

  For example, the reception control unit 232 controls reception of encoded data transmitted from the recording device 221, and supplies the encoded data to the HDD 233 for recording.

  The HDD 233 records the encoded data supplied from the reception control unit 232.

  The playback control unit 234 is configured in the same manner as the playback control unit 15 in FIG. 1, reads encoded data recorded in the HDD 233 from the HDD 233, decodes it, and supplies the resulting HD moving image to the monitor 16. To do.

  32 configured as described above, for example, an HD moving image is supplied from the HDTV camera 12 to the recording control unit 223 of the recording device 221. The recording control unit 223 performs the same processing as the recording control unit 13 in FIG. 1 on the HD moving image from the HDTV camera 12, and supplies the encoded data obtained as a result to the HDD 224 for recording. The transmission control unit 225 reads the encoded data recorded in the HDD 224 and transmits it to the reception control unit 232 of the playback device 231 via a network or the like.

  The reception control unit 232 of the playback device 231 receives the encoded data from the recording device 221 and supplies it to the HDD 233 for recording. The playback control unit 234 reads the encoded data recorded in the HDD 233 as necessary, performs the same processing as that of the playback control unit 15 in FIG. 1, and supplies the resulting HD moving image to the monitor 16.

  FIG. 33 is a block diagram illustrating a configuration example of a computer that executes the series of processes described above by a program.

  A CPU (Central Processing Unit) 251 executes various processes according to a program stored in a ROM (Read Only Memory) 252 or a storage unit 258. A RAM (Random Access Memory) 253 appropriately stores programs executed by the CPU 251 and data. The CPU 251, ROM 252, and RAM 253 are connected to each other via a bus 254.

  As the CPU 251, the Cell described in “Birth of Cell”, Nikkei Electronics, Nikkei BP, February 28, 2005, pages 89 to 117 can be employed.

  An input / output interface 255 is also connected to the CPU 251 via the bus 254. Connected to the input / output interface 255 are an input unit 256 made up of a keyboard, mouse, microphone, and the like, and an output unit 257 made up of a display, a speaker, and the like. The CPU 251 executes various processes in response to commands input from the input unit 256. Then, the CPU 251 outputs the processing result to the output unit 257.

  The storage unit 258 connected to the input / output interface 255 includes, for example, a hard disk, and stores programs executed by the CPU 251 and various data. The communication unit 259 communicates with an external device via a network such as the Internet or a local area network.

  Further, a program may be acquired via the communication unit 259 and stored in the storage unit 258.

  The drive 260 connected to the input / output interface 255 drives a removable medium 261 such as a magnetic disk, an optical disk, a magneto-optical disk, or a semiconductor memory, and drives programs and data recorded there. Get etc. The acquired program and data are transferred to and stored in the storage unit 258 as necessary.

  The series of processes described above can be executed by hardware or can be executed by software. When a series of processing is executed by software, a program constituting the software executes various functions by installing a computer incorporated in dedicated hardware or various programs. For example, it is installed from a program recording medium in a general-purpose personal computer or the like.

  As shown in FIG. 35, a program recording medium for storing a program that is installed in a computer and is ready to be executed by the computer is a magnetic disk (including a flexible disk), an optical disk (CD-ROM (Compact Disc-Read Only). Memory), DVD (including Digital Versatile Disc), magneto-optical disk), or removable media 261 which is a package medium made of semiconductor memory, or ROM 252, where programs are temporarily or permanently stored, The storage unit 258 is configured by a hard disk or the like. The program is stored in the program recording medium using a wired or wireless communication medium such as a local area network, the Internet, or digital satellite broadcasting via a communication unit 259 which is an interface such as a router or a modem as necessary. Done.

  In the present specification, the step of describing the program stored in the program recording medium is not limited to the processing performed in time series in the order described, but is not necessarily performed in time series. Or the process performed separately is also included.

  Further, in this specification, the system represents the entire apparatus constituted by a plurality of apparatuses.

Here, in the embodiment of the present invention, the grouping target is a scene, but the grouping can also be performed on a picture. That is, for example, using the histogram of each picture constituting the above-described HD moving image (for example, the histograms 62 _{1 to} 62 _n in FIG. 7), a similarity value indicating the degree of similarity between pictures is represented as a scene histogram. The similar values obtained from the above are obtained in the same manner, and the pictures whose similarity values are equal to or less than the threshold value are grouped into one group, or the pictures whose similarity values are equal to or less than the threshold value, and the motion of the entire picture It is possible to group pictures whose vector sum is less than another threshold into one group. Further, for example, grouping for pictures can use inter-picture difference values instead of histograms.

  By grouping the pictures, the pictures that make up the scene that contains the object that is moving periodically, and the pictures that make up the scene where the brightness changes greatly due to the camera flash, etc. It becomes possible to divide into groups of more similar pictures.

  The embodiment of the present invention is not limited to the above-described embodiment, and various modifications can be made without departing from the gist of the present invention.

It is a block diagram which shows the structural example of one Embodiment of the recording / reproducing system to which this invention is applied. It is a block diagram which shows the structural example of the recording control part 13 of FIG. It is a block diagram which shows the structural example of the rearrangement compression part 22 of FIG. It is a block diagram which shows the structural example of the image information preparation part 32 of FIG. FIG. 5 is a block diagram illustrating a configuration example of a scene detection unit 41 in FIG. 4. It is a figure explaining the process of the scene division part 52 of FIG. It is a figure explaining the process in the histogram preparation part 42 of FIG. It is a figure explaining an example of the process in the grouping part 33 of FIG. It is a figure explaining the process in the grouping part 33 and the compression part 34 of FIG. FIG. 4 is a diagram illustrating a format of encoded data of a picture output from a compression unit 34 in FIG. 3. It is a flowchart which shows the process in the rearrangement compression part 22 of FIG. It is a flowchart which shows the detail of the image information creation process in step S12 of FIG. It is a flowchart which shows the detail of the scene detection process of step S21 of FIG. It is a flowchart which shows the detail of the grouping process of step S13 of FIG. FIG. 2 is a block diagram illustrating a configuration example of a reproduction control unit 15 in FIG. 1. FIG. 4 is a diagram for explaining the order of reading encoded data of a scene (pictures constituting the scene) from the HDD 14 by the input / output interface 111 and the order of reading the pictures from the buffer 113 by the output control unit 114. 16 is a flowchart showing processing in the reproduction control unit 15 of FIG. It is a block diagram which shows the structural example of the reproduction | regeneration control part 15 comprised using the some decompression | decompression part. It is a block diagram which shows the other structural example of the reproduction | regeneration control part 15 of FIG. FIG. 20 is a block diagram illustrating a configuration of the decompression unit 122 of FIG. 19. It is a block diagram which shows the other structural example of the reproduction | regeneration control part 15 comprised using the some decompression | decompression part. It is a block diagram which shows the other structural example of the recording control part 13 of FIG. It is a block diagram which shows the structural example of the reduction image creation part 163 of FIG. It is a block diagram which shows the other structural example of the rearrangement compression part 22 of FIG. It is a figure explaining the process in the grouping part 33, the compression part 34, the encoder selection part 181, and the compression part 182 of FIG. FIG. 25 is a diagram illustrating a format of encoded data of a picture output from the compression unit 34 or the compression unit 182 of FIG. 24. It is a flowchart which shows the process in the rearrangement compression part 22 of FIG. It is a block diagram which shows the other structural example of the reproduction | regeneration control part 15 of FIG. FIG. 4 is a diagram for explaining the order of reading encoded data of a scene (pictures constituting the scene) from the HDD 14 by the input / output interface 201 and the order of reading the pictures from the buffer 113 by the output control unit 114. It is a flowchart which shows the process in the reproduction | regeneration control part 15 of FIG. FIG. 12 is a block diagram illustrating still another configuration example of the reproduction control unit 15 in FIG. 1. It is a block diagram which shows the structural example of other embodiment of the recording / reproducing system to which this invention is applied. It is a block diagram which shows the structural example of the computer which executes the program to which this invention is applied.

Explanation of symbols

DESCRIPTION OF SYMBOLS 11 Recording / reproducing apparatus, 12 HDTV camera, 13 Recording control part, 14 HDD, 15 Playback control part, 16 Monitor, 21 Input / output interface, 22 Rearrangement compression part, 31 Picture display number addition part, 32 Image information creation part, 33 Grouping unit, 34 compression unit, 41 scene detection unit, 42 histogram creation unit, 51 inter-picture difference unit, 52 scene division unit, 61 _{1 to} 61 _n picture, 62 _{1 to} 62 _n histogram, 63 _m histogram, 111 input / output interface 112 decompression unit, 112 _{1 to} 112 _n decompression unit, 113 buffer, 114 output control unit, 121 input / output interface, 122 decompression unit, 122 _{1 to} 122 _n decompression unit, 131 buffer, 132 variable length decoding unit, 133 inverse quantum Conversion unit, 134 buffer, 135 output control unit, 13 Inverse DCT unit, 137 calculation unit, 138 buffer, 139 motion compensation unit, 161 compression unit, 162 decompression unit, 163 reduced image creation unit, 164 intra compression unit, 165 intra decompression unit, 171 LPF, 172 downsampling unit, 181 encoder Selection unit, 182 compression unit, 201 input / output interface, 202 decompression unit, 211 input / output interface, 213 buffer, 214 output control unit, 221 recording device, 223 recording control unit, 224 HDD, 225 transmission control unit, 231 playback device, 232 reception control unit, 233 HDD, 234 playback control unit, 251 CPU, 252 ROM, 253 RAM, 254 bus, 255 I / O interface, 256 input unit, 257 output unit, 258 recording unit, 259 communication unit, 260 drive, 261 Removable Bed and breakfasts

Claims (12)

In a recording / reproducing apparatus for recording moving image data on a recording medium and reproducing the moving image data from the recording medium,
Detecting means for detecting a scene that is a set of similar series of pictures from the moving image data composed of a plurality of pictures;
Based on the inter-picture difference value of each picture constituting the scene, for each scene, one of predictive coding or non-predictive coding representing coding different from the predictive coding is included in the scene Selecting means for selecting as an encoding method when encoding
Acquisition means for acquiring image information used to group the scenes into similar groups of pictures;
Grouping means for grouping one or more similar scenes into one group, the scenes having the predictive coding selected as the picture coding method based on the image information;
First encoding means for performing the predictive encoding on the pictures constituting the group for each group;
Second encoding means for performing the non-predictive encoding on a picture included in the scene for which the non-predictive encoding is selected as the picture encoding method;
Recording control means for recording the first encoded data obtained by the predictive encoding and the second encoded data obtained by the non-predictive encoding on the recording medium;
Read control means for reading the first and second encoded data from the recording medium in a decoding order for decoding the first and second encoded data;
First decoding means for performing predictive decoding corresponding to the predictive encoding for the first encoded data read from the recording medium for each group;
Second decoding means for performing non-predictive decoding corresponding to the non-predictive encoding on the second encoded data read from the recording medium;
Output control means for outputting pictures obtained by the predictive decoding and the non-predictive decoding in the order of display ;
The first encoding means performs MPEG (Moving Picture Expert Group) encoding as the predictive encoding,
The second encoding means performs intra encoding using wavelet transform as the non-predictive encoding,
The first decoding means includes
As the predictive decoding, MPEG decoding corresponding to the MPEG encoding is performed,
Recording means for recording DCT (Discrete Cosine Transform) coefficient obtained in the middle of the MPEG decoding,
The second decoding means performs intra decoding using inverse wavelet transform as the non-predictive decoding,
When outputting the picture obtained by the MPEG decoding, the output control means causes the DCT coefficients recorded in the recording means to be decoded and output to the pictures in display order.
Record reproducing apparatus. The selection means includes
Determining whether or not there are a predetermined number of pictures having a difference value between pictures equal to or greater than a predetermined value;
If it is determined that there are more than the predetermined number of pictures having the inter-picture difference value equal to or greater than the predetermined value, the non-predictive encoding is selected.
The recording / reproducing apparatus according to claim 1, wherein when it is determined that there are no more than the predetermined number of pictures having the inter-picture difference value equal to or greater than the predetermined value, the predictive coding is selected. Among the pictures constituting the scene, the inter-picture difference value of a predetermined picture is:
The sum of squares of the difference between pixel values of pixels at the same position between the predetermined picture and the adjacent picture adjacent to the predetermined picture among the pictures arranged in the display order constituting the scene,
The sum of squares of the difference between the average values of the pixel values for each block when the predetermined picture and the adjacent picture are divided into blocks,
The sum of squares of the difference between the motion vectors of each pixel for each block,
The square sum of the difference between the number of pixels of each pixel value of the histogram when the histogram of the pixel value of the predetermined picture and the histogram of the pixel value of the adjacent picture are created. Recording / playback device. A creation unit for creating a reduced image obtained by reducing the picture;
The recording / reproducing apparatus according to claim 1, wherein the acquisition unit acquires the image information using the reduced image. The recording / reproducing apparatus according to claim 1, comprising a plurality of the first decoding means. In a recording / reproducing method of a recording / reproducing apparatus for recording moving image data on a recording medium and reproducing the moving image data from the recording medium,
A detection step of detecting a scene which is a set of similar series of pictures from the moving image data constituted by a plurality of pictures;
Based on the inter-picture difference value of each picture constituting the scene, for each scene, one of predictive coding or non-predictive coding representing coding different from the predictive coding is included in the scene A selection step of selecting as an encoding method when encoding
Obtaining image information used to group the scenes into similar groups of pictures;
A grouping step of grouping one or more similar scenes into one group, the scenes having the predictive encoding selected as the picture encoding method based on the image information;
For each group, a first encoding step for performing the predictive encoding on pictures constituting the group;
A second encoding step for performing the non-predictive encoding on a picture included in the scene for which the non-predictive encoding is selected as the picture encoding method;
A recording control step of recording the first encoded data obtained by the predictive encoding and the second encoded data obtained by the non-predictive encoding on the recording medium;
A read control step of reading the first and second encoded data from the recording medium in a decoding order for decoding the first and second encoded data;
A first decoding step for performing predictive decoding corresponding to the predictive encoding on the first encoded data read from the recording medium for each group;
A second decoding step of performing non-predictive decoding corresponding to the non-predictive encoding on the second encoded data read from the recording medium;
Look including an output control step of outputting a picture obtained by said prediction decoding and the non-predictive decoding in the display order,
The first encoding step performs MPEG (Moving Picture Expert Group) encoding as the predictive encoding,
The second encoding step performs an intra encoding using a wavelet transform as the non-predictive encoding,
The first decoding step performs MPEG decoding corresponding to the MPEG encoding as the predictive decoding,
The recording / reproducing apparatus has recording means for recording a DCT (Discrete Cosine Transform) coefficient obtained in the middle of the MPEG decoding,
The second decoding step performs intra decoding using inverse wavelet transform as the non-predictive decoding,
In the output control step, when a picture obtained by the MPEG decoding is output, the DCT coefficients recorded in the recording unit are decoded into the picture in the display order and output.
Record reproduction method. In a recording apparatus for recording moving image data on a recording medium,
Detecting means for detecting a scene that is a set of similar series of pictures from the moving image data composed of a plurality of pictures;
Based on the inter-picture difference value of each picture constituting the scene, for each scene, one of predictive coding or non-predictive coding representing coding different from the predictive coding is included in the scene Selecting means for selecting as an encoding method when encoding
Acquisition means for acquiring image information used to group the scenes into similar groups of pictures;
Grouping means for grouping one or more similar scenes into one group, the scenes having the predictive coding selected as the picture coding method based on the image information;
First encoding means for performing the predictive encoding on the pictures constituting the group for each group;
Second encoding means for performing the non-predictive encoding on a picture included in the scene for which the non-predictive encoding is selected as the picture encoding method;
Recording control means for recording the first encoded data obtained by the predictive encoding and the second encoded data obtained by the non-predictive encoding on the recording medium ,
The first encoding means performs MPEG encoding as the predictive encoding,
The second encoding means performs intra encoding using wavelet transform as the non-predictive encoding.
Record apparatus. The recording apparatus according to claim 7 , further comprising transmission control means for transmitting the first and second encoded data recorded on the recording medium to another apparatus that reproduces the moving image data. In a recording method of a recording apparatus for recording moving image data on a recording medium,
A detection step of detecting a scene which is a set of similar series of pictures from the moving image data constituted by a plurality of pictures;
Based on the inter-picture difference value of each picture constituting the scene, for each scene, one of predictive coding or non-predictive coding representing coding different from the predictive coding is included in the scene A selection step of selecting as an encoding method when encoding
Obtaining image information used to group the scenes into similar groups of pictures;
A grouping step of grouping one or more similar scenes into one group, the scenes having the predictive encoding selected as the picture encoding method based on the image information;
For each group, a first encoding step for performing the predictive encoding on pictures constituting the group;
A second encoding step for performing the non-predictive encoding on a picture included in the scene for which the non-predictive encoding is selected as the picture encoding method;
The first encoded data obtained by predictive coding, and said second encoded data obtained by the non-predictive coding, see contains a recording control step of recording on the recording medium,
The first encoding step performs MPEG encoding as the predictive encoding,
The second encoding step performs intra encoding using wavelet transform as the non-predictive encoding.
Record method. In a playback device for playing back moving image data,
Detecting a scene which is a set of similar pictures from the moving image data composed of a plurality of pictures;
Based on the inter-picture difference value of each picture constituting the scene, for each scene, one of predictive coding or non-predictive coding representing coding different from the predictive coding is included in the scene Is selected as the encoding method when encoding
One or more similar scenes in which the predictive coding is selected as the picture coding method based on image information used to group the scenes into similar groups of pictures Group them into one group,
For each group, the first encoded data obtained by performing MPEG encoding as the predictive encoding for the pictures constituting the group, and the non-predictive encoding as the encoding method of the picture From the recording medium on which the second encoded data obtained by performing intra encoding using wavelet transform as the non-predictive encoding for the picture included in the scene for which is selected Read control means for reading out the first and second encoded data in decoding order for decoding the first and second encoded data;
First decoding means for performing predictive decoding corresponding to the predictive encoding for the first encoded data read from the recording medium for each group;
Second decoding means for performing non-predictive decoding corresponding to the non-predictive encoding on the second encoded data read from the recording medium;
Output control means for outputting pictures obtained by the predictive decoding and the non-predictive decoding in the order of display ;
The first decoding means includes
As the predictive decoding, MPEG decoding corresponding to the MPEG encoding is performed,
Recording means for recording DCT coefficients obtained in the middle of the MPEG decoding;
The second decoding means performs intra decoding using inverse wavelet transform as the non-predictive decoding,
When outputting the picture obtained by the MPEG decoding, the output control means causes the DCT coefficients recorded in the recording means to be decoded and output to the pictures in display order.
Playback apparatus. Receiving control means for receiving the first and second encoded data transmitted from another device;
The reproducing apparatus according to claim 10 , wherein the first and second encoded data received by the reception control unit are recorded on the recording medium. In a playback method of a playback device for playing back moving image data,
Detecting a scene which is a set of similar pictures from the moving image data composed of a plurality of pictures;
Based on the inter-picture difference value of each picture constituting the scene, for each scene, one of predictive coding or non-predictive coding representing coding different from the predictive coding is included in the scene Is selected as the encoding method when encoding
One or more similar scenes in which the predictive coding is selected as the picture coding method based on image information used to group the scenes into similar groups of pictures Group them into one group,
For each group, the first encoded data obtained by performing MPEG encoding as the predictive encoding for the pictures constituting the group, and the non-predictive encoding as the encoding method of the picture From the recording medium on which the second encoded data obtained by performing intra encoding using wavelet transform as the non-predictive encoding for the picture included in the scene for which is selected A read control step of reading out the first and second encoded data in a decoding order for decoding the first and second encoded data;
A first decoding step for performing predictive decoding corresponding to the predictive encoding on the first encoded data read from the recording medium for each group;
A second decoding step of performing non-predictive decoding corresponding to the non-predictive encoding on the second encoded data read from the recording medium;
Look including an output control step of outputting a picture obtained by said prediction decoding and the non-predictive decoding in the display order,
The first decoding step performs MPEG decoding corresponding to the MPEG encoding as the predictive decoding,
The playback device has recording means for recording DCT coefficients obtained during the MPEG decoding,
The second decoding step performs intra decoding using inverse wavelet transform as the non-predictive decoding,
In the output control step, when a picture obtained by the MPEG decoding is output, the DCT coefficients recorded in the recording unit are decoded into the picture in the display order and output.
Playback method.

Images