JP2017034729A - Dynamic image predictive decoding method and dynamic image predictive decoding device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To solve the problem that in a NAL unit header of a conventional method, even in the case where a value of nal_ref_flag is significantly determined in accordance with a value of nal_unit_type, bits are allocated to nal_ref_flag and nal_unit_type and design may be inefficient.SOLUTION: A dynamic image predictive decoding method includes: an input step for inputting compressed image data; and a decoding step for decoding NAL unit header information and a reference picture set (RPS) to restore the compressed image data as regenerative image data. The RPS identifies a set of pictures to be used for inter-screen prediction of associated pictures, and the NAL unit header information includes nal_unit_type significantly indicating whether to use the regenerative image data for the inter-screen prediction when decoding the other picture in the same temporal layer.SELECTED DRAWING: Figure 5

Description

  The present invention relates to a moving picture predictive decoding method and a moving picture predictive decoding apparatus.

  In a conventional moving image compression technique, a bit stream is encapsulated in a network abstraction layer (NAL) unit. NAL units provide self-contained packets, giving the video layer identity in different network environments. The header of the NAL unit includes information necessary for the system layer. The header of the NAL unit becomes part of the packet header in the packet network and is designed to work with Media Aware Network Elements (MANEs).

  The prior art NAL unit header includes the following syntax elements: nal_ref_flag indicates whether or not the NAL unit is used for reference in the decoding process of another NAL unit. nal_unit_type indicates the type of content conveyed by the NAL unit. The NAL unit contains information such as parameter sets, coded slices, supplemental enhancement information (SEI) messages. temporal_id indicates the time identifier of the NAL unit.

  The prior art is described in Non-Patent Document 1.

Benjamin Bross et. Al., "Highefficiency video coding (HEVC) text specification draft 7", JointCollaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO / IECJTC1 / SC29 / WG11, 9th Meeting: Geneva, CH, 27th April-7th May 2012

  The NAL unit header is a limited resource, as MANEs are designed to look at the minimum number of bytes at the beginning of a packet. In the prior art, the NAL unit header is only 2 bytes. Therefore, all syntax elements of the NAL unit header are important and should convey as much information as possible and uncorrelated with other syntax elements.

表１は、ｎａｌ＿ｕｎｉｔ＿ｔｙｐｅの値（NAL unit type range列）とｎａｌ＿ｒｅｆ＿ｆｌａｇが取りうる値（Possible nal_ref_flag列）との対応を示す表である。ここで、ｎａｌ＿ｕｎｉｔ＿ｔｙｐｅの値が１、２、あるいは３であるＮＡＬユニットタイプは、ｎａｌ＿ｒｅｆ＿ｆｌａｇの値として０あるいは１をとりうる。残りのＮＡＬユニットタイプはリザーブされている、あるいは仕様化されていない。 For most NAL unit types, nal_ref_flag is not required because nal_ref_flag needs to be set to a fixed value. In the specification described in Non-Patent Document 1, there are only three types of NAL unit types in which nal_ref_flag can take a value of 0 or 1. In other NAL unit types defined in the specification, the value of nal_ref_flag is fixed. This is shown in Table 1.

Table 1 is a table showing the correspondence between the value of nal_unit_type (NAL unit type range column) and the value that nal_ref_flag can take (Possible nal_ref_flag column). Here, the NAL unit type whose nal_unit_type value is 1, 2, or 3 can take 0 or 1 as the value of nal_ref_flag. The remaining NAL unit types are reserved or not specified.

  Thus, even when the value of nal_ref_flag is uniquely determined according to the value of nal_unit_type, in the conventional method, bits are assigned to each of nal_ref_flag and nal_unit_type, which is an inefficient design.

  The solution to solve the above problem is to imply from the NAL unit type without explicitly sending nal_ref_flag in the NAL unit header. Three types of NAL unit types implying that nal_ref_flag is 1 are added to the three types of NAL unit types whose contents of the NAL unit can be reference pictures or non-reference pictures. For the original three NAL unit types, nal_ref_flag is 0.

  In order to solve the above-described problem, a moving picture predictive decoding method according to the present invention is a moving picture predictive decoding method executed by a moving picture predictive decoding apparatus, and compresses a plurality of pictures constituting a moving picture. An input step for inputting compressed image data encapsulated in a NAL unit together with NAL unit header information, including reference picture set (RPS), and decoding and compressing the NAL unit header information and RPS A plurality of pictures constituting the moving image are classified into a plurality of temporal layers, and the RPS is a picture used for inter-picture prediction of related pictures. The NAL unit header information indicates that the reproduced image data has other pixels in the same temporal layer. Includes nal_unit_type uniquely indicating whether used for inter-picture prediction in decoding tea, the RPS other pictures free of non-reference picture in the same temporal layer.

  The NAL unit header information in the video predictive decoding method according to the present invention includes nal_unit_type that uniquely indicates whether the reproduced image data is used in decoding order for inter-screen prediction in decoding of subsequent pictures of the same temporal layer. RPS of subsequent pictures in decoding order may not include non-reference pictures of the same temporal layer.

  The moving picture predictive decoding apparatus according to the present invention is compressed image data for a plurality of pictures constituting a moving picture, includes a reference picture set (RPS), and is encapsulated in a NAL unit together with NAL unit header information. A plurality of pictures constituting a moving image, comprising: input means for inputting the compressed image data, and decoding means for decoding the NAL unit header information and RPS and restoring the compressed image data as reproduced image data. Classified into multiple temporal layers, the RPS identifies the set of pictures used for inter-picture prediction of related pictures, and the NAL unit header information decodes other pictures in the same temporal layer that the reconstructed image data Nal_unit_type that uniquely indicates whether or not to use for inter-screen prediction when Kucha the RPS does not include the non-reference picture in the same temporal layer.

  The NAL unit header information in the moving picture predictive decoding apparatus according to the present invention includes nal_unit_type that uniquely indicates whether or not the reproduced image data is used in the decoding order for inter-picture prediction in decoding of subsequent pictures of the same temporal layer. RPS of subsequent pictures in decoding order may not include non-reference pictures of the same temporal layer.

  The effect of the present invention is to save bits used in nal_ref_flag and make them available as other instruction information. This is a more efficient use of the NAL unit header. Another use is that the NAL unit type can be expanded from 6 bits to 7 bits. At present, half of the 64 available nal_unit_type values are assigned the existing NAL unit type, and the 32 nal_unit_type values are reserved and can be used when defining a new NAL unit type in the future. By using three of these reserved NAL unit type values and expanding the number of bits of the NAL unit type to 7 bits, 93 (128-32-3 = 93) additional NAL units will be added in the future. Can be prescribed.

It is a block diagram which shows the moving image predictive coding apparatus which concerns on embodiment of this invention. It is a block diagram which shows the moving image predictive decoding apparatus which concerns on embodiment of this invention. It is a flowchart which shows the flow of a process of the moving image predictive encoding method which concerns on embodiment of this invention. It is a flowchart which shows the detailed flow of a one part process among the processes of the moving image predictive encoding method which concerns on embodiment of this invention. It is a flowchart which shows the flow of a process of the moving image predictive decoding method which concerns on embodiment of this invention. It is a flowchart which shows the detailed flow of a one part process among the processes of the moving image predictive decoding method which concerns on embodiment of this invention. It is a figure which shows the hardware constitutions of the computer for performing the program recorded on the recording medium. It is a perspective view of a computer for executing a program stored in a recording medium. It is a block diagram which shows the structural example of a moving image predictive encoding program. It is a block diagram which shows the structural example of a moving image prediction decoding program.

  Hereinafter, embodiments of the present invention will be described with reference to FIGS.

  First, the video predictive coding method according to the present invention will be described. FIG. 1 is a block diagram showing a video predictive coding apparatus according to an embodiment of the present invention. 101 is an input terminal, 102 is a block divider, 103 is a prediction signal generator, 104 is a frame memory, 105 is a subtractor, 106 is a converter, 107 is a quantizer, 108 is a dequantizer, and 109 is an inverse transform , 110 is an adder, 111 is an entropy encoder, 112 is an output terminal, and 113 is an input terminal. The input terminal 101 corresponds to input means. The subtractor 105, the converter 106, the quantizer 107, and the entropy encoder 111 correspond to encoding means. The inverse quantizer 108, the inverse transformer 109, and the adder 110 correspond to decoding means.

  The operation of the video predictive coding apparatus configured as described above will be described below. A moving image signal composed of a plurality of images is input to the input terminal 101. An image to be encoded is divided into a plurality of regions by the block divider 102. In the embodiment according to the present invention, the block is divided into 8 × 8 pixels, but may be divided into other block sizes or shapes. Next, a prediction signal is generated for a region to be encoded (hereinafter referred to as a target block). In the embodiment according to the present invention, two kinds of prediction methods are used. That is, inter-screen prediction and intra-screen prediction.

  In inter-screen prediction, a reproduction image that has been encoded in the past and then restored is used as a reference image, and motion information that gives a prediction signal with the smallest error for the target block is obtained from this reference image. This process is called motion detection. Further, according to circumstances, the target block may be subdivided, and the inter-screen prediction method may be determined for the subdivided small area. In this case, the most efficient division method and the respective motion information are determined from the various division methods for the entire target block. In the embodiment according to the present invention, the prediction signal generator 103 inputs the target block via the line L102 and the reference image via L104. As the reference image, a plurality of images encoded and restored in the past are used as the reference image. For details, refer to the conventional techniques MPEG-2, 4, H.264. It is the same as any of the H.264 methods. The motion information and the small area dividing method determined in this way are sent to the entropy encoder 111 via the line L112, encoded, and sent out from the output terminal 112. Also, information (reference index) regarding which reference image the prediction signal is acquired from among a plurality of reference images is also sent to the entropy encoder 111 via the line L112. The prediction signal generator 103 acquires a reference image signal from the frame memory 104 based on the reference image and motion information corresponding to each small region dividing method and each small region, and generates a prediction signal. The inter-screen prediction signal generated in this way is sent to the subtractor 105 via the line L103.

  In intra-screen prediction, an intra-screen prediction signal is generated using already reproduced pixel values spatially adjacent to the target block. Specifically, the prediction signal generator 103 acquires already reproduced pixel signals in the same screen from the frame memory 104 and extrapolates these signals to generate an in-screen prediction signal. Information regarding the extrapolation method is sent to the entropy encoder 111 via the line L112, encoded, and sent from the output terminal 112. The intra-screen prediction signal generated in this way is sent to the subtractor 105. The prediction signal generation method in the screen in the prediction signal generator 103 is a conventional technique of H.264. This is the same as the H.264 method. Of the inter-screen prediction signal and the intra-screen prediction signal obtained as described above, the signal having the smallest error is selected and sent to the subtractor 105.

  The subtractor 105 subtracts the prediction signal (via the line L103) from the signal of the target block (via the line L102) to generate a residual signal. This residual signal is subjected to discrete cosine transform by a converter 106, and each coefficient thereof is quantized by a quantizer 107. Finally, the transform coefficient quantized by the entropy encoder 111 is encoded and transmitted from the output terminal 112 together with information on the prediction method.

  In order to perform intra prediction or inter prediction for the subsequent target block, the compressed signal of the target block is inversely processed and restored. That is, the quantized transform coefficient is inversely quantized by the inverse quantizer 108 and then inverse discrete cosine transformed by the inverse transformer 109 to restore the residual signal. The residual signal restored by the adder 110 and the prediction signal sent from the line L103 are added, and the signal of the target block is reproduced and stored in the frame memory 104. In the present embodiment, converter 106 and inverse converter 109 are used, but other conversion processes in place of these converters may be used. In some cases, the converter 106 and the inverse converter 109 may be omitted.

  Information about the display order of each image, the type for encoding the image (intra-screen predictive coding, inter-screen predictive coding, bi-directional predictive coding), and information about the NAL unit type are input from the input terminal 113. Based on these information Thus, the prediction signal generator 103 operates. These pieces of information are sent to the entropy encoder 111 via the line L113, encoded, and sent from the output terminal 112. The operation of the entropy encoder 111 for encoding the NAL unit type will be described later.

  Next, the video predictive decoding method according to the present invention will be described. FIG. 2 shows a block diagram of an image predictive decoding apparatus according to an embodiment of the present invention. 201 is an input terminal, 202 is a data analyzer, 203 is an inverse quantizer, 204 is an inverse transformer, 205 is an adder, 206 is an output terminal, 207 is a frame memory, 208 is a prediction signal generator, and 209 is a frame memory It is a manager. The input terminal 201 corresponds to input means. The data analyzer 202, inverse quantizer 203, inverse transformer 204, and adder 205 correspond to decoding means. Any other decoding means may be used. Further, the inverse converter 204 may not be provided.

  The operation of the video predictive decoding apparatus configured as described above will be described below. The compressed data compressed and encoded by the method described above is input from the input terminal 201. The compressed data includes a residual signal encoded by predicting a target block obtained by dividing an image into a plurality of blocks, information related to generation of a prediction signal, and the like. In addition to the NAL unit type, information related to the generation of the prediction signal includes information on block division (block size) and information on motion information and the above-described reference index in the case of inter-screen prediction. In this case, information on the extrapolation method is included from the surrounding already reproduced pixels.

  The data analyzer 202 extracts the residual signal of the target block, information related to the generation of the prediction signal including the NAL unit type, the quantization parameter, and the display order information of the image from the compressed data. The operation for extracting the NAL unit type in the data analyzer 202 will be described later. The residual signal of the target block is inversely quantized by the inverse quantizer 203 based on the quantization parameter (via the line L202). The result is subjected to inverse discrete cosine transform by an inverse transformer 204.

  Next, information related to the generation of the prediction signal, such as the display order information of the target image, the image encoding type NAL unit type, and the reference index, is sent to the prediction signal generator 208 via the line L206. The prediction signal generator 208 accesses the frame memory 207 based on information related to generation of the prediction signal, acquires a reference signal from a plurality of reference images (via the line L207), and generates a prediction signal. This prediction signal is sent to the adder 205 via the line L208, added to the restored residual signal, reproduces the target block signal, and is output from the output terminal 206 via the line L205 and stored in the frame memory 207 at the same time. .

  The frame memory 207 stores a reproduced image used for decoding / reproducing subsequent images.

表２および表３において、Ｄｅｓｃｒｉｐｔｏｒ列の括弧内の数字は、対応する項目が有するビット数を表す。 Tables 2 and 3 are tables showing two syntax options related to the usage pattern of 2 bytes of the NAL unit header.

In Tables 2 and 3, the numbers in parentheses in the Descriptor column represent the number of bits that the corresponding item has.

  In the NAL unit header syntax of Table 2, nal_ref_flag is replaced with a reserved bit (reserved). This bit is ignored by current decoders, but new meanings and semantics can be assigned for future decoders. Note that the bit arrangement in Table 2 is for illustrative purposes only, and the reserved bits may be arranged elsewhere in the 2-byte header.

  In the NAL unit header syntax of Table 3, 7 bits are assigned to nal_unit_type, and up to 128 different nal_unit_types can be defined. In this embodiment, it is selected that 7 bits are assigned to nal_unit_type, but the bits saved by nal_ref_flag may be assigned to temporal_id.

表４は、ｎａｌ＿ｕｎｉｔ＿ｔｙｐｅの値から推定されるｎａｌ＿ｒｅｆ＿ｆｌａｇの値を示す表である。ＮＡＬユニットタイプは表４の２列目に示されるように、複数のカテゴリにグループ分けすることができる。そのカテゴリとは下記の通りである。１）ＲＡＰスライス（RAP slice）：ランダム・アクセス・ピクチャの符号化スライスを含んでいるＮＡＬユニット
２）ＴＬＡスライス（TLA slice）：テンポラル・レイヤー・アクセスの符号化スライスを含んでいるＮＡＬユニット
３）ＴＦＤスライス（TFD slice）：ディスカードのためのタグ付けがされたピクチャの符号化スライスを含んでいるＮＡＬユニット
４）その他のスライス（Other slice）：上記のいずれでもない符号化スライスを含んでいるＮＡＬユニット
５）パラメータ・セット（Parameter Set）：ビデオ、シーケンス、ピクチャの適応パラメータセットを含んでいるＮＡＬユニット
６）インフォメーション（Information）：アクセス・デリミタ、フィラーデータ、あるいはサプリメンタル・エンハンスメント・インフォメーション（ＳＥＩ）を含んでいるＮＡＬユニット Table 4 shows NAL unit types in the present embodiment.

Table 4 is a table showing the value of nal_ref_flag estimated from the value of nal_unit_type. NAL unit types can be grouped into multiple categories as shown in the second column of Table 4. The categories are as follows. 1) RAP slice: NAL unit 2 containing coded slice of random access picture 2) TLA slice: NAL unit 3 containing coded slice of temporal layer access 3) TFD slice (TFD slice): NAL unit 4 containing coded slice of tagged picture for discarding Other slice: containing coded slice that is not any of the above NAL unit 5) Parameter Set: NAL unit 6 containing adaptive parameter set of video, sequence, picture. Information: Information: Access delimiter, filler data, or supplemental enhancement information (SEI). ) Comprising at which NAL unit

In this embodiment, three new NAL unit types corresponding to 9, 10, and 11 are added to the nal_unit_type of the prior art as values of nal_unit_type (picture type). These NAL units having the value of nal_unit_type include the same slice type as the NAL units having 1, 2, and 3 as values of nal_unit_type, respectively. nal_unit_type: 1 contains non-RAP, non-TFD and non-TLA picture coding slices, nal_unit_type: 2 contains TFD picture coding slices, nal_unit_type: 3 contains non-TFD TLA picture coding slices .
The difference from the prior art is that, in this embodiment, values 1, 2, and 3 are coded slices belonging to non-reference pictures, and values 9, 10, and 11 are coded slices belonging to non-reference pictures. .

  The values assigned to the respective categories are not limited to the above. In addition, each category may be expanded into several subcategories and the reserved values in Table 4 may be used to assign new values to those subcategories.

  FIG. 3 shows the operation of the video predictive encoding apparatus for encoding the NAL unit header in this embodiment. In step 110, the video predictive coding apparatus acquires video data to be packetized. In step 120, the first bit of the NAL unit, which is always fixed at 0, is encoded. In step 130, nal_unit_type is determined and encoded. In step 140, temporal_id is encoded, and in step 150, the reserved 5 bits (reserved_one_5bits) are encoded to complete the NAL unit header. In step 160, the remaining payload is packetized and the process ends.

  FIG. 4 shows details of the process for determining and encoding nal_unit_type in step 130 described above.

  In step 210, the video predictive coding apparatus determines whether or not the data to be packetized is a coded slice belonging to any of the random access pictures (RAP), and encodes belonging to any of the RAPs. If it is a slice (YES), the process proceeds to step 220. If not (NO), the process proceeds to Step 230.

  In step 220, the video predictive encoding apparatus encodes 4 to 8 nal_unit_types implying that nal_ref_flag is 1 according to the RAP type, and then proceeds to step 140.

  In step 230, the video predictive coding apparatus determines whether or not the data to be packetized is a parameter set. If the data is a parameter set (YES), the process proceeds to step 240. Otherwise (NO), go to step 250.

  In step 240, the video predictive coding apparatus codes nal_unit_type from 25 to 28 implying that nal_ref_flag is 1 according to the parameter set, and proceeds to step 140.

  In step 250, the moving picture predictive coding apparatus determines whether or not the data to be packetized is information data. If the data is information data (YES), the process proceeds to step 260. If not (NO), the process proceeds to Step 270.

  In step 260, the video predictive encoding apparatus encodes nal_unit_type from 29 to 31 implying that nal_ref_flag is 0 according to the information type, and proceeds to step 140.

  In step 270, the video predictive coding apparatus determines whether or not the data to be packetized is a reference picture. If the data is a reference picture (YES), the process proceeds to step 280. If not (NO), the process proceeds to Step 290. Here, the determination of whether or not it is a reference picture is performed based on reference information between pictures output from the prediction signal generator.

  The conditional branch in step 270 may be as follows. In step 270, the video data must be either a reference picture or a non-reference picture. In step 270, the video predictive coding apparatus determines whether or not the picture is a reference picture. If the picture is a reference picture (YES), the process proceeds to step 280. If not (NO), the process proceeds to Step 290.

  In step 280, the video predictive encoding apparatus encodes nal_unit_type from 9 to 11 implying that nal_ref_flag is 1 according to the slice type, and proceeds to step 140.

  In step 290, the video predictive encoding apparatus encodes nal_unit_type of 1 to 3 implying that nal_ref_flag is 0 according to the slice type, and proceeds to step 140.

  FIG. 5 shows the operation of the video predictive decoding apparatus for decoding the NAL unit header in this embodiment. In step 310, the moving picture predictive decoding apparatus acquires the next packet for decoding. In step 320, the first bit (forbidden_zero_bit) of the NAL unit which is always fixed to 0 is decoded. In step 330, nal_unit_type is decoded and the value of nal_ref_flag is set. In step 340, temporal_id is decoded, and in step 350, the reserved 5 bits (reserved_one_5 bits) are decoded to complete the NAL unit header. In step 360, the remaining payload is read from the packet and the process ends.

  FIG. 6 shows details of processing in the decoding of nal_unit_type and the setting of the value of nal_ref_flag in step 330 described above.

  In step 400, the video predictive decoding apparatus acquires the value of nal_unit_type by decoding the NAL unit header.

  In step 410, the video predictive decoding apparatus determines whether the value of nal_unit_type is any one from 1 to 3, and if it is any one from 1 to 3 (YES), the NAL unit is a non-reference picture. , And proceeds to step 420. Otherwise (NO), the process proceeds to step 430.

  In step 420, the video predictive decoding apparatus sets the value of nal_ref_flag to 0, and proceeds to step 340.

  In step 430, the moving picture predictive decoding apparatus determines whether the value of nal_unit_type is any of 4 to 11, and if it is any of 4 to 11 (YES), the NAL unit is randomly accessed. Includes one of the coded slice of the picture or the coded slice of the reference picture, and proceeds to step 440. If not (NO), the process proceeds to step 450.

  In step 450, the video predictive decoding apparatus sets the value of nal_ref_flag to 1, and proceeds to step 340.

  In step 450, the moving picture predictive decoding apparatus determines whether the value of nal_unit_type is any of 25 to 28. If it is any of 25 to 28 (YES), the NAL unit sets the parameter set. The process proceeds to step 460. If not (NO), the process proceeds to Step 470.

  In step 460, the moving picture predictive decoding apparatus sets the value of nal_ref_flag to 1, and proceeds to step 340.

  In step 470, the moving picture predictive decoding apparatus determines whether or not the value of nal_unit_type is any of 29 to 31, and if it is any of 29 to 31 (YES), the NAL unit is the information data. The process proceeds to step 480. Otherwise (NO), nal_unit_type is an invalid value and the process proceeds to step 490.

  In step 480, the moving picture predictive decoding apparatus sets the value of nal_ref_flag to 0, and proceeds to step 340.

  In step 490, the moving picture predictive decoding apparatus sets the value of nal_ref_flag as undefined, and proceeds to step 340.

表５では、ｎａｌ＿ｒｅｆ＿ｆｌａｇの３２通りのエントリーは表４の最終列と同様の値に設定されている。 In the present embodiment, the above-described setting of nal_ref_flag is through logical determination, but the value of nal_ref_flag may be set using a nal_ref_flag reference table with nal_unit_type as an index. Table 5 is an example of a reference table of nal_ref_flag using nal_unit_type as an index.

In Table 5, 32 kinds of entries of nal_ref_flag are set to values similar to those in the last column of Table 4.

  Note that the above-described estimation or setting method of nal_ref_flag is not limited to the moving picture predictive decoding apparatus, and can be applied to MANEs.

  In this embodiment, the video predictive decoding apparatus may select not to set nal_ref_flag, and may directly use the value of nal_unit_type when determining whether or not the decoded picture is a reference picture. . This can be explained as follows using a logical expression. When the nal_unit_type of the picture is 1, 2, or 3, the picture is a non-reference picture. Otherwise, the picture is a reference picture and is saved for use by other pictures for reference.

  In the present embodiment, the definition of the reference picture and the non-reference picture is applied to the entire video. However, this definition may no longer be accurate if a selection frame drop process is performed in which the video discards higher temporal layer pictures.

  In such a situation, some reference pictures may become pictures that are not actually referenced. In order to avoid this, reference pictures with nal_unit_type of 9, 10, and 11 and non-reference pictures with nal_unit_type of 1, 2, and 3 may be defined as follows.

  A reference picture is a picture used for inter-screen prediction by any other picture in the same temporal layer as the picture.

  A non-reference picture is a picture that is not used for inter-screen prediction by any other picture in the same temporal layer as the picture.

  In the conventional method described in Non-Patent Document 1, inter-screen prediction is indicated by the contents of a reference picture set (RPS) that defines which pictures can be used for inter-screen prediction. Therefore, the above definition may be written as follows:

  A non-reference picture (nal_unit_type is 1, 2 or 3) is not included in the RPS of any other picture in the same temporal layer as the picture.

  The reference picture (nal_unit_type is 9, 10 or 11) is included in the RPS of any other picture in the same temporal layer as the picture.

  A moving picture predictive coding program and a moving picture predictive decoding program according to the present invention for causing a computer to function as the above-described moving picture predictive coding apparatus and moving picture predictive decoding apparatus are provided as a program stored in a recording medium. . Examples of the recording medium include a floppy (registered trademark) disk, a CD-ROM, a DVD, a ROM, or a recording medium, or a semiconductor memory.

  FIG. 7 is a diagram showing a hardware configuration of a computer for executing a program recorded on the recording medium, and FIG. 8 is a perspective view of the computer for executing the program stored on the recording medium. Examples of the computer include a DVD player, a set-top box, a mobile phone, and the like that have a CPU and perform processing and control by software.

  As shown in FIG. 7, the computer 30 includes a reading device 12 such as a floppy (registered trademark) disk drive device, a CD-ROM drive device, a DVD drive device, and a working memory (RAM) 14 in which an operating system is resident. , A memory 16 for storing a program stored in the recording medium 10, a display device 18 such as a display, a mouse 20 and a keyboard 22 as input devices, a communication device 24 for transmitting and receiving data and the like, and execution of the program CPU 26 for controlling the above. When the recording medium 10 is inserted into the reading device 12, the computer 30 can access the moving image predictive encoding / decoding program stored in the recording medium 10 from the reading device 12, and the moving image predictive encoding / decoding is performed. The program makes it possible to operate as a moving picture predictive encoding apparatus / decoding apparatus according to the present invention.

  As shown in FIG. 8, the video predictive encoding program or video decoding program may be provided via a network as a computer data signal 40 superimposed on a carrier wave. In this case, the computer 30 may store the moving picture predictive coding program or the moving picture predictive decoding program received by the communication device 24 in the memory 16 and execute the moving picture predictive coding program or the moving picture predictive decoding program. it can.

  Specifically, as illustrated in FIG. 9, the moving image predictive encoding program P100 includes an input module P101 that inputs a plurality of images constituting a moving image, and the image is either in-screen prediction or inter-screen prediction. An encoding module P102 that encodes by a program to generate compressed image data and packetizes the packet header information, and the packet header information includes a picture type, and the encoding module P102 encodes the picture type It is a moving picture predictive encoding program characterized by determining so that the converted picture data may be uniquely used for reference when decoding other pictures.

  Similarly, as illustrated in FIG. 10, the moving picture predictive decoding program P200 encodes a plurality of pictures constituting a moving picture by either intra-screen prediction or inter-screen prediction, and packetizes the packet header information. In addition, an input module P201 for inputting compressed image data and a decoding module P202 for restoring packet header information and compressed image data are provided, and the restored picture data is used for decoding other pictures by the packet header information. The decoding module P202 includes a picture type that uniquely indicates whether or not to be used for reference, and the decoding module P202 uses the restored picture data based on the picture type for reference when decoding other pictures. It is a moving picture predictive decoding program characterized by determining whether to use.

  The decoding module P202 is based on a pre-stored correspondence table in which picture types are associated with information indicating whether or not the restored picture data is used for reference when decoding other pictures. It may be characterized in that it is determined whether the restored picture data is used for reference when decoding other pictures.

  In order to solve the above-described problem, a moving image predictive coding apparatus according to the present invention includes an input unit that inputs a plurality of images constituting a moving image, and the image is either in-screen prediction or inter-screen prediction. Encoding means for generating compressed image data and packetizing together with packet header information, wherein the packet header information includes a picture type, and the encoding means is encoded with the picture type. The picture data is determined so as to uniquely indicate whether or not the picture data is used for reference when decoding other pictures.

  The video predictive decoding apparatus according to the present invention is a compressed image that is encoded by either intra-screen prediction or inter-screen prediction and packetized together with packet header information for a plurality of images constituting the video. Input means for inputting data, and decoding means for restoring packet header information and compressed image data. The packet header information is used for reference when the restored picture data is decoded by other pictures. The decoding means determines whether or not the restored picture data is used for reference when decoding other pictures based on the picture type, including a picture type that uniquely indicates whether or not it is used It is characterized by.

  The decoding means in the video predictive decoding apparatus according to the present invention corresponds to the picture type and information indicating whether or not the restored picture data is used for reference when decoding other pictures. Based on the pre-stored correspondence table attached, it is determined whether the restored picture data is used for reference when decoding other pictures.

  A moving image predictive encoding method according to the present invention includes an input step of inputting a plurality of images constituting a moving image, the image is encoded by any one of intra prediction or inter prediction, and compressed image data is encoded. An encoding step of generating and packetizing together with the packet header information, wherein the packet header information includes a picture type, and the encoding step includes the picture type, the encoded picture data includes other pictures. It is characterized in that it is determined so as to uniquely indicate whether or not it is used for reference when decoding.

  The moving image predictive decoding method according to the present invention is a method of decoding compressed image data encoded by either intra-screen prediction or inter-screen prediction and packetized together with packet header information for a plurality of images constituting a moving image. An input step for inputting, and a decoding step for restoring packet header information and compressed image data. The packet header information is used for reference when the restored picture data is decoded by another picture. The decoding step determines whether the restored picture data is used for reference when decoding other pictures, based on the picture type, It is characterized by that.

  In the decoding step in the video predictive decoding method according to the present invention, the picture type is associated with information indicating whether or not the restored picture data is used for reference when decoding other pictures. Based on a correspondence table stored in advance, it is determined whether the restored picture data is used for reference when decoding other pictures.

  A moving image predictive encoding program according to the present invention includes an input module that inputs a plurality of images constituting a moving image, and the image is encoded with either an intra-screen prediction or an inter-screen prediction program. An encoding module that generates and packetizes the packet header information, the packet header information includes a picture type, the encoding module includes a picture type, and the encoded picture data includes other pictures. It is characterized in that it is determined so as to uniquely indicate whether or not it is used for reference when decoding.

  The moving picture predictive decoding program according to the present invention encodes compressed image data encoded by either intra-screen prediction or inter-screen prediction and packetized together with packet header information for a plurality of images constituting a moving image. An input module for inputting and a decoding module for restoring packet header information and compressed image data are provided, and the packet header information is used for reference when the restored picture data is decoded by other pictures. A decoding module that uniquely indicates whether or not, based on the picture type, the decoding module determines whether the restored picture data is used for reference when decoding other pictures, It is characterized by that.

  The decoding module in the video predictive decoding program according to the present invention associates a picture type with information indicating whether or not the restored picture data is used for reference when decoding other pictures. Based on a correspondence table stored in advance, it is determined whether the restored picture data is used for reference when decoding other pictures.

  In order to solve the above-described problem, a moving picture predictive coding apparatus according to the present invention includes an input unit that inputs a plurality of pictures constituting a moving picture, encodes the pictures, generates compressed picture data, and generates a NAL unit. Encoding means for encapsulating the NAL unit together with header information, and the plurality of pictures constituting the moving image are classified into a plurality of temporal layers, the NAL unit header information includes nal_unit_type, and the encoding means includes: , Nal_unit_type is determined to uniquely indicate whether the encoded picture data is used for reference when decoding other pictures of the same temporal layer.

  The video predictive decoding apparatus according to the present invention includes an input unit that inputs compressed image data in which a plurality of pictures constituting a video is encoded and encapsulated in a NAL unit together with NAL unit header information; Decoding means for restoring unit header information and compressed image data, and a plurality of pictures constituting a moving image are classified into a plurality of temporal layers, and the restored picture data is the same as the NAL unit header information. The decoding means includes nal_unit_type that uniquely indicates whether the picture is used for reference when decoding other pictures in the temporal layer, and the decoding means restores the compressed image data based on nal_unit_type.

  The moving picture predictive coding method according to the present invention includes an input step for inputting a plurality of pictures constituting a moving picture, a picture is coded, compressed picture data is generated, and is encapsulated in a NAL unit together with NAL unit header information. A plurality of pictures constituting a moving image are classified into a plurality of temporal layers, the NAL unit header information includes nal_unit_type, and the encoding step includes nal_unit_type encoded pictures. It is determined to uniquely indicate whether the data is used for reference in decoding other pictures of the same temporal layer.

  The video predictive decoding method according to the present invention includes an input step of inputting compressed image data in which a plurality of pictures constituting a video are encoded and encapsulated in a NAL unit together with NAL unit header information, and a NAL unit header A decoding step for restoring information and compressed image data, wherein a plurality of pictures constituting a moving image are classified into a plurality of temporal layers, and the NAL unit header information includes the same temporal It includes nal_unit_type that uniquely indicates whether it is used for reference when decoding other pictures of the layer, and the decoding step restores the compressed image data based on nal_unit_type.

  A moving picture predictive coding program according to the present invention encodes a picture by inputting an input module that inputs a plurality of pictures constituting the moving picture, generates compressed image data, and encapsulates the NAL unit together with NAL unit header information. A plurality of pictures constituting a moving image are classified into a plurality of temporal layers, the NAL unit header information includes nal_unit_type, and the encoding module encodes nal_unit_type. It is determined to uniquely indicate whether the data is used for reference in decoding other pictures of the same temporal layer.

  The moving picture predictive decoding program according to the present invention includes an input module for inputting compressed image data in which a plurality of pictures constituting a moving picture are encoded and encapsulated in the NAL unit together with NAL unit header information, and a NAL unit header. A decoding module that restores information and compressed image data, wherein a plurality of pictures constituting a moving image are classified into a plurality of temporal layers, and the NAL unit header information includes the same temporal The decoding module restores the compressed image data based on nal_unit_type, including nal_unit_type that uniquely indicates whether or not the picture is used for reference when decoding other pictures of the layer.

  The moving picture predictive coding apparatus according to the present invention inputs a plurality of pictures constituting a moving picture, encodes the pictures, generates compressed picture data, and encapsulates the NAL units together with NAL unit header information. Encoding means, the NAL unit header information includes nal_unit_type, and the encoding means uses nal_unit_type to determine whether encoded picture data is used for reference when decoding other pictures. It is determined so as to uniquely indicate whether or not.

  The moving picture predictive decoding apparatus according to the present invention includes an input means for inputting compressed image data in which a plurality of pictures constituting a moving picture are encoded and encapsulated in a NAL unit together with NAL unit header information, and a NAL unit header. Decoding means for restoring information and compressed image data, and the NAL unit header information uniquely indicates whether the restored picture data is used for reference when decoding other pictures. nal_unit_type is included, and the decoding unit decodes the compressed image data based on nal_unit_type.

  The decoding means in the moving picture predictive decoding apparatus according to the present invention has previously associated nal_unit_type and information indicating whether or not the restored picture data is used for reference when decoding other pictures. The compressed image data may be decoded based on the stored correspondence table.

  The moving picture predictive coding method according to the present invention includes an input step for inputting a plurality of pictures constituting a moving picture, a picture is coded, compressed picture data is generated, and is encapsulated in a NAL unit together with NAL unit header information. The NAL unit header information includes nal_unit_type, and the encoding step uses nal_unit_type to determine whether the encoded picture data is used for reference when decoding other pictures. It is determined so as to uniquely indicate whether or not.

  The video predictive decoding method according to the present invention includes an input step of inputting compressed image data in which a plurality of pictures constituting a video are encoded and encapsulated in a NAL unit together with NAL unit header information, and a NAL unit header A decoding step for restoring information and compressed image data, and the NAL unit header information uniquely indicates whether the restored picture data is used for reference when decoding other pictures. nal_unit_type is included, and the decoding step decodes the compressed image data based on nal_unit_type.

  In the decoding step in the video predictive decoding method according to the present invention, nal_unit_type is associated with information indicating whether or not the restored picture data is used for reference when decoding other pictures. The compressed image data may be decoded based on the stored correspondence table.

  DESCRIPTION OF SYMBOLS 101 ... Input terminal, 102 ... Block divider, 103 ... Prediction signal generator, 104 ... Frame memory, 105 ... Subtractor, 106 ... Converter, 107 ... Quantizer, 108 ... Inverse quantizer, 109 ... Inverse transformation 110 ... adder, 111 ... entropy encoder, 112 ... output terminal, 113 ... input terminal, 201 ... input terminal, 202 ... data analyzer, 203 ... inverse quantizer, 204 ... inverse transformer, 205 ... Adder, 206 ... output terminal, 207 ... frame memory, 208 ... prediction signal generator.

Claims (4)

A video predictive decoding method executed by a video predictive decoding device,
An input step for inputting compressed image data for a plurality of pictures constituting a moving image, including a reference picture set (RPS) and encapsulated in a NAL unit together with NAL unit header information; ,
A decoding step of decoding the NAL unit header information and the RPS, and restoring the compressed image data as reproduced image data;
Including
The plurality of pictures constituting the moving image are classified into a plurality of temporal layers,
The RPS identifies a set of pictures used for inter-picture prediction of related pictures;
The NAL unit header information includes nal_unit_type that uniquely indicates whether or not the reproduced image data is used for inter-screen prediction when decoding other pictures of the same temporal layer.
The RPS of the other pictures does not include non-reference pictures of the same temporal layer;
Video predictive decoding method. The NAL unit header information includes nal_unit_type that uniquely indicates whether the reproduced image data is used in decoding order for inter-picture prediction in decoding of subsequent pictures of the same temporal layer,
The RPS of the subsequent pictures in decoding order does not include non-reference pictures of the same temporal layer;
The moving picture predictive decoding method according to claim 1. Input means for inputting compressed image data for a plurality of pictures constituting a moving image, including a reference picture set (RPS) and encapsulated in a NAL unit together with NAL unit header information ,
Decoding means for decoding the NAL unit header information and the RPS and restoring the compressed image data as reproduced image data;
Comprising
The plurality of pictures constituting the moving image are classified into a plurality of temporal layers,
The RPS identifies a set of pictures used for inter-picture prediction of related pictures;
The NAL unit header information includes nal_unit_type that uniquely indicates whether or not the reproduced image data is used for inter-screen prediction when decoding other pictures of the same temporal layer.
The RPS of the other pictures does not include non-reference pictures of the same temporal layer;
Video predictive decoding apparatus. The NAL unit header information includes nal_unit_type that uniquely indicates whether the reproduced image data is used in decoding order for inter-picture prediction in decoding of subsequent pictures of the same temporal layer,
The RPS of the subsequent pictures in decoding order does not include non-reference pictures of the same temporal layer;
The moving picture predictive decoding apparatus according to claim 3.

Images