JP2013141077A - Video encoding device, video encoding method, and video encoding program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To improve encoding efficiency of motion information while suppressing a processing load when performing encoding using motion information of adjacent blocks.SOLUTION: A spatial merge motion information candidate list generation unit 1000 calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to a block to be encoded as motion information candidates for the block to be encoded to generate a motion information candidate list. A merge motion information candidate list deletion unit 1001 deletes, from the candidate list, a redundant motion information candidate among the motion information candidates included in the candidate list generated by the spatial merge motion information candidate list generation unit 1000. A temporal merge motion information candidate list generation unit 1002 calculates a motion information candidate for the block to be encoded using motion information of an encoded adjacent block temporally adjacent to the block to be encoded, and adds it to the candidate list processed by the merge motion information candidate list deletion unit 1001.

Description

  The present invention relates to a moving picture coding technique using motion compensated prediction, and more particularly to a moving picture coding apparatus, a moving picture coding method, and a moving picture coding program used for motion compensated prediction.

  MPEG-4 AVC / H. In moving picture coding represented by H.264 (hereinafter AVC), motion compensated prediction is used in which a picture is divided into rectangular blocks, and motion estimation and compensation are performed in units of blocks between pictures. A motion vector generated in each block in motion compensation prediction is subjected to a prediction process in order to reduce the code amount.

  In AVC, by utilizing the fact that there is a strong correlation between motion vectors of adjacent blocks, a prediction value is calculated from the adjacent block, and a code amount is reduced by encoding a difference vector with the prediction value. Yes. However, in these prediction methods, since the positions of adjacent blocks to be referred to are limited, there is a problem that if the prediction is not successful, the difference between the motion vectors becomes large and the generated code amount increases. In addition, although the amount of motion vector coding is reduced, other motion information such as the prediction direction and the reference image index is encoded for each block to be processed, so that there is a problem that efficient encoding has not been achieved. It was.

  In order to solve these problems, as in Patent Document 1, by encoding additional information for specifying an adjacent block to be referred to from among a plurality of adjacent blocks, the motion information of the block to be processed is encoded. Instead, a merge encoding technique is used in which the motion information of adjacent blocks is used for encoding to reduce the code amount.

JP-A-10-276439

  Merge encoding reduces the amount of code and reduces the coding efficiency by encoding using the motion information of spatially and temporally adjacent blocks without encoding the motion information of the block to be processed. Has improved. Also, a plurality of adjacent block candidates to be referred to are prepared, and additional information specifying the adjacent block to be referenced is encoded, so that an adjacent block closer to the motion information of the encoding target block can be referred to.

  Therefore, if the reference adjacent block candidate includes a plurality of adjacent blocks having the same motion information, the types of motion information that can be expressed by the reference adjacent block candidate are reduced, and as a result, the encoding efficiency is not improved. Therefore, when the motion information of the reference adjacent block candidates is compared in detail and the reference adjacent block candidates having the same motion information are reduced, the processing amount increases.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a technique for reducing the processing load and improving the encoding efficiency of motion information when encoding is performed using the motion information of adjacent blocks. It is to provide.

  In order to solve the above-described problem, a moving image encoding device according to an aspect of the present invention is a moving image encoding device that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image. A motion information calculation unit (906) for calculating motion information candidates of the encoding target block and generating a motion information candidate list; and a candidate information in the candidate list output from the motion information calculation unit (906). A combination in which one neighboring block is designated as a reference block for referring to motion information among neighboring blocks having motion information, and the motion information of the designated reference block is used as motion information of the encoding target block. When the prediction mode is selected, the motion information of the designated reference block obtained from the candidate list output from the motion information calculation unit (906) is used. , With coding the coding target block includes encoding unit encoding an index indicating the specified reference block and (103, 110). The motion information calculation unit (906) calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and Among the candidate motion information included in the candidate list generated by the spatial candidate list generation unit (1000) that generates the candidate list and the candidate list generated by the spatial candidate list generation unit (1000), at least the motion vector values match each other. If there is a candidate, a candidate list deletion unit (1001) that deletes one of the candidates for motion information from the candidate list, and motion information of an encoded adjacent block temporally adjacent to the encoding target block The candidate list of motion information of the coding target block is calculated using the candidate list processed by the candidate list deletion unit (1001). And a time candidate list generation unit to be added (1002) to.

  Another aspect of the present invention is also a moving image encoding apparatus. The apparatus is a moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image, calculates a motion information candidate of an encoding target block, A motion information calculation unit (906) that generates a candidate list of information, and one adjacent block among the adjacent blocks including the motion information in the candidate list output from the motion information calculation unit (906) When the joint prediction mode that uses the motion information of the designated reference block as the motion information of the coding target block is selected as the reference block for referring to the motion information calculation unit (906) Encoding the target block using the motion information of the specified reference block obtained from the candidate list output from And a coding unit configured to code (103, 110) an index indicating the reference blocks. The motion information calculation unit (906) calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and Among the candidate motion information included in the candidate list generated by the spatial candidate list generation unit (1000) that generates the candidate list and the candidate list generated by the spatial candidate list generation unit (1000), at least the motion vector values match each other. If there is a candidate, a candidate list deletion unit (1001) that deletes one of the candidates for motion information from the candidate list, and motion information of an encoded adjacent block temporally adjacent to the encoding target block The candidate list of motion information of the coding target block is calculated using the candidate list processed by the candidate list deletion unit (1001). And a time candidate list generation unit to be added (1002) to. The candidate list deletion unit (1001) compares adjacent candidates in the arrangement order of the candidate list, and compares the highest candidate with the lowest candidate so that at least the motion vector values match each other. Determine if there is something.

  Yet another embodiment of the present invention is also a moving image encoding apparatus. The apparatus is a moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image, calculates a motion information candidate of an encoding target block, A motion information calculation unit (906) that generates a candidate list of information, and one adjacent block among the adjacent blocks including the motion information in the candidate list output from the motion information calculation unit (906) When the joint prediction mode that uses the motion information of the designated reference block as the motion information of the coding target block is selected as the reference block for referring to the motion information calculation unit (906) Encoding the target block using the motion information of the specified reference block obtained from the candidate list output from And a coding unit configured to code (103, 110) an index indicating the reference blocks. The motion information calculation unit (906) calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and Among the candidate motion information included in the candidate list generated by the spatial candidate list generation unit (1000) that generates the candidate list and the candidate list generated by the spatial candidate list generation unit (1000), at least the motion vector values match each other. If there is a candidate, a candidate list deletion unit (1001) that deletes one of the candidates for motion information from the candidate list, and motion information of an encoded adjacent block temporally adjacent to the encoding target block The candidate list of motion information of the coding target block is calculated using the candidate list processed by the candidate list deletion unit (1001). And a time candidate list generation unit to be added (1002) to. The candidate list deletion unit (1001) determines whether or not there are at least motion vector values that are the same among the candidates included in the order of arrangement of the candidate list from the top to the predetermined.

  Yet another embodiment of the present invention is also a moving image encoding apparatus. The apparatus is a moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image, calculates a motion information candidate of an encoding target block, A motion information calculation unit (906) that generates a candidate list of information, and one adjacent block among the adjacent blocks including the motion information in the candidate list output from the motion information calculation unit (906) When the joint prediction mode that uses the motion information of the designated reference block as the motion information of the coding target block is selected as the reference block for referring to the motion information calculation unit (906) Encoding the target block using the motion information of the specified reference block obtained from the candidate list output from And a coding unit configured to code (103, 110) an index indicating the reference blocks. The motion information calculation unit (906) calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and Among the candidate motion information included in the candidate list generated by the spatial candidate list generation unit (1000) that generates the candidate list and the candidate list generated by the spatial candidate list generation unit (1000), at least the motion vector values match each other. If there is a candidate, a candidate list deletion unit (1001) that deletes one of the candidates for motion information from the candidate list, and motion information of an encoded adjacent block temporally adjacent to the encoding target block The candidate list of motion information of the coding target block is calculated using the candidate list processed by the candidate list deletion unit (1001). And a time candidate list generation unit to be added (1002) to. The candidate list deletion unit (1001), when the number of candidates registered in the candidate list is less than a predetermined maximum number of candidates, after duplicating the lowest candidate in the candidate list and filling in empty candidates, By comparing candidates that are adjacent in the arrangement order of the candidate list and comparing the highest candidate and the lowest candidate, it is determined whether or not there are at least motion vector values that match each other.

  Yet another embodiment of the present invention is also a moving image encoding apparatus. The apparatus is a moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image, calculates a motion information candidate of an encoding target block, A motion information calculation unit (906) that generates a candidate list of information, and one adjacent block among the adjacent blocks including the motion information in the candidate list output from the motion information calculation unit (906) When the joint prediction mode that uses the motion information of the designated reference block as the motion information of the coding target block is selected as the reference block for referring to the motion information calculation unit (906) Encoding the target block using the motion information of the specified reference block obtained from the candidate list output from And a coding unit configured to code (103, 110) an index indicating the reference blocks. The motion information calculation unit (906) calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and Among the candidate motion information included in the candidate list generated by the spatial candidate list generation unit (1000) that generates the candidate list and the candidate list generated by the spatial candidate list generation unit (1000), at least the motion vector values match each other. If there is a candidate, a candidate list deletion unit (1001) that deletes one of the candidates for motion information from the candidate list, and motion information of an encoded adjacent block temporally adjacent to the encoding target block The candidate list of motion information of the coding target block is calculated using the candidate list processed by the candidate list deletion unit (1001). And a time candidate list generation unit to be added (1002) to. When the number of candidates registered in the candidate list is 4, the candidate list deletion unit (1001) compares adjacent candidates for the third to third in the order of the candidate list, By comparing the lower candidate with the highest candidate, and further comparing the lowest candidate with the second candidate, it is determined whether or not there are at least motion vector values that match each other.

  Yet another embodiment of the present invention is also a moving image encoding apparatus. The apparatus is a moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image, calculates a motion information candidate of an encoding target block, A motion information calculation unit (906) that generates a candidate list of information, and one adjacent block among the adjacent blocks including the motion information in the candidate list output from the motion information calculation unit (906) When the joint prediction mode that uses the motion information of the designated reference block as the motion information of the coding target block is selected as the reference block for referring to the motion information calculation unit (906) Encoding the target block using the motion information of the specified reference block obtained from the candidate list output from And a coding unit configured to code (103, 110) an index indicating the reference blocks. The motion information calculation unit (906) calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and A spatial candidate list generation unit (4000) that generates a candidate list, and motion information candidates of the encoding target block by using motion information of encoded adjacent blocks that are temporally adjacent to the encoding target block Included in the candidate list generated by the time candidate list generation unit (4002) and the time candidate list generation unit (4002) to be calculated and added to the candidate list processed by the space candidate list generation unit (4000) If there is a motion information candidate that matches at least the motion vector values, one of the motion information candidates is selected as the candidate of the motion information. Including candidate list deletion unit that you want to delete from the list and (4001). The candidate list deletion unit (4001) determines whether or not there are at least motion vector values that coincide with each other among candidates included from the top to the predetermined in the order of arrangement of the candidate list.

  Yet another aspect of the present invention is a video encoding method. This method is a moving image encoding method that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image, and calculates motion information candidates of an encoding target block, A motion information calculation step for generating a candidate list of information, and a reference for referring to the motion information for one adjacent block among the adjacent blocks provided with motion information in the candidate list output from the motion information calculation step Obtained from the candidate list output from the motion information calculation step when a joint prediction mode is selected in which motion information of the designated reference block is used as motion information of the encoding target block. In addition, the motion information of the designated reference block is used to encode the coding target block and the designated reference block. An index indicating a click and a coding step of coding. The motion information calculation step calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and obtains a motion information candidate list. If there is a candidate of the motion information included in the candidate list generated by the candidate candidate list generated by the candidate candidate list generated by the candidate spatial list generation step, at least one of the motion vector values matches, A candidate list deletion step of deleting motion information candidates from the candidate list, and motion information of the encoding target block using the motion information of the encoded adjacent block temporally adjacent to the encoding target block. A candidate time candidate is calculated and added to the candidate list processed by the candidate list deletion step. And a step.

  Yet another embodiment of the present invention is also a moving image encoding method. This method is a moving image encoding method that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image, and calculates motion information candidates of an encoding target block, A motion information calculation step for generating a candidate list of information, and a reference for referring to the motion information for one adjacent block among the adjacent blocks provided with motion information in the candidate list output from the motion information calculation step Obtained from the candidate list output from the motion information calculation step when a joint prediction mode is selected in which motion information of the designated reference block is used as motion information of the encoding target block. In addition, the motion information of the designated reference block is used to encode the coding target block and the designated reference block. An index indicating a click and a coding step of coding. The motion information calculation step calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and obtains a motion information candidate list. A spatial candidate list generation step to generate, and motion information candidates of the encoding target block are calculated using motion information of an encoded adjacent block temporally adjacent to the encoding target block, and the spatial candidates The time candidate list generation step to be added to the candidate list processed by the list generation step and the motion information candidates included in the candidate list generated by the time candidate list generation step have at least motion vector values mutually. If there is a match, a candidate list for deleting one of the motion information candidates from the candidate list And a deletion step. In the candidate list deletion step, it is determined whether or not there are at least motion vector values that coincide with each other among candidates included in the order of arrangement of the candidate list from the highest level to a predetermined number.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, and the like are also effective as an aspect of the present invention.

  ADVANTAGE OF THE INVENTION According to this invention, the encoding efficiency of motion information can be improved, suppressing the load at the time of processing motion information.

It is a figure which shows the structure of the moving image encoder which concerns on Embodiment 1 of this invention. It is a figure which shows an example of an encoding target image. It is a figure which shows the detailed definition of prediction block size. 4A to 4D are diagrams for explaining the prediction direction of motion compensation prediction. It is a flowchart which shows the flow of the operation | movement of the encoding process in the moving image encoder which concerns on Embodiment 1 of this invention. It is a figure which shows the structure of the moving image decoding apparatus which concerns on Embodiment 1 of this invention. It is a flowchart which shows the flow of operation | movement of the decoding process in the moving image decoding apparatus which concerns on Embodiment 1 of this invention. FIGS. 8A and 8B are diagrams illustrating two prediction modes for encoding motion information used in motion compensation prediction in Embodiment 1 of the present invention. FIG. 5 is a diagram illustrating a detailed configuration of a prediction mode determination unit in the video encoding device according to the first embodiment. FIG. 10 is a diagram showing a configuration of a combined motion information calculation unit in FIG. 9 in the first embodiment. It is a flowchart explaining the detailed operation | movement of the motion compensation prediction mode / predicted signal generation process of step S502 of FIG. 12 is a flowchart for explaining a detailed operation of the combined motion information candidate list generation of FIG. 11 in the first embodiment. It is a figure which shows the space candidate block group used for a space joint motion information candidate list generation. It is a flowchart explaining the detailed operation | movement of a space joint motion information candidate list generation. 5 is a flowchart for explaining detailed operation of combined motion information candidate deletion in the first embodiment. FIG. 10 is a diagram illustrating a comparison relationship of motion information candidates in combined motion information candidate deletion in the first embodiment. FIG. 10 is a diagram illustrating a comparison relationship of motion information candidates in combined motion information candidate deletion in the first embodiment. It is a figure which shows the time candidate block group used for a time joint movement information candidate list generation. It is a flowchart explaining the detailed operation | movement of time coupling | bonding motion information candidate list generation. It is a figure explaining the calculation method of motion vector value mvL0t and mvL1t registered with respect to the reference | standard motion vector value ColMv with respect to time coupling | bonding motion information with respect to L0 prediction and L1 prediction. It is a flowchart explaining the detailed operation | movement of a 1st joint motion information candidate list addition part. It is a figure explaining the relationship between the frequency | count of combination inspection, combined motion information candidate M, and combined motion information candidate N. It is a flowchart explaining the detailed operation | movement of a 2nd joint motion information candidate list addition part. It is a flowchart explaining the detailed operation | movement of the joint prediction mode evaluation value production | generation process of FIG. It is a figure which shows the Truncated Unary code sequence when the number of combined motion information candidates is 5. It is a flowchart explaining the detailed operation | movement of the prediction mode evaluation value production | generation process of FIG. 5 is a diagram illustrating a detailed configuration of a motion information decoding unit in the video decoding device in Embodiment 1. FIG. It is a flowchart explaining the detailed operation | movement of the motion information decoding process of FIG. It is a flowchart explaining the detailed operation | movement of the joint prediction motion information decoding process of FIG. It is a flowchart explaining the detailed operation | movement of the prediction motion information decoding process of FIG. 10 is a flowchart for explaining a detailed operation of combined motion information candidate deletion in the second embodiment. FIG. 10 is a diagram illustrating comparison contents of motion information candidates in combined motion information candidate deletion in the second embodiment. FIG. 10 is a diagram showing a comparison relationship of motion information candidates in combined motion information candidate deletion in the second embodiment. FIG. 10 is a diagram showing a comparison relationship of motion information candidates in combined motion information candidate deletion in the second embodiment. 18 is a flowchart for explaining a detailed operation of combined motion information candidate deletion in the third embodiment. FIG. 10 is a diagram showing a comparison relationship of motion information candidates in combined motion information candidate deletion in the third embodiment. FIG. 16 is a diagram showing comparison contents of motion information candidates in combined motion information candidate deletion in the third embodiment. 18 is a flowchart for explaining a detailed operation of combined motion information candidate deletion in the fourth embodiment. FIG. 20 is a diagram illustrating a comparison relationship of motion information candidates in combined motion information candidate deletion in the fourth embodiment. It is a figure which shows the comparison content of the motion information candidate in combined motion information candidate deletion in Embodiment 4. FIG. 29 is a flowchart for explaining detailed operation of combined motion information candidate deletion in the fifth embodiment. FIG. 25 is a diagram showing a comparison relationship of motion information candidates in combined motion information candidate deletion in the fifth embodiment. FIG. 25 is a diagram showing comparison contents of motion information candidates in combined motion information candidate deletion in the fifth embodiment. FIG. 25 is a diagram showing a comparison relationship of motion information candidates in combined motion information candidate deletion in the fifth embodiment. It is a figure explaining the usable condition of block A0. FIG. 10 is a diagram illustrating a configuration of a combined motion information calculation unit in FIG. 9 according to Embodiment 6. 29 is a flowchart for describing detailed operation of combined motion information candidate list generation in the sixth embodiment. FIG. 38 is a diagram illustrating comparison contents of motion information candidates in combined motion information candidate deletion in the sixth embodiment. FIG. 38 is a diagram showing a comparison relationship of motion information candidates in combined motion information candidate deletion in the sixth embodiment.

  DESCRIPTION OF EXEMPLARY EMBODIMENTS Preferred embodiments of a moving image encoding apparatus, a moving image encoding method, a moving image encoding program, a moving image decoding apparatus, a moving image decoding method, and a moving image decoding program according to an embodiment of the present invention will be described below with reference to the drawings. A form is demonstrated in detail. In the description of the drawings, the same elements are denoted by the same reference numerals, and redundant description is omitted.

(Embodiment 1)
[Overall configuration of video encoding apparatus]
FIG. 1 is a diagram showing a configuration of a moving picture coding apparatus according to Embodiment 1 of the present invention. Hereinafter, the operation of each unit will be described. The moving picture coding apparatus according to Embodiment 1 includes an input terminal 100, a subtraction unit 101, an orthogonal transformation / quantization unit 102, a prediction error coding unit 103, an inverse quantization / inverse transformation unit 104, an addition unit 105, and a decoding An image memory 106, a motion vector detection unit 107, a motion compensation prediction unit 108, a prediction mode determination unit 109, a motion information encoding unit 110, a motion information memory 111, a multiplexing unit 112, and an output terminal 113 are provided.

  The image signal of the prediction block to be encoded is extracted from the image signal input from the input terminal 100 based on the position information and the prediction block size of the prediction block, and the image signal of the prediction block is subtracted by the subtractor 101, the motion vector. This is supplied to the detection unit 107 and the prediction mode determination unit 109.

  FIG. 2 is a diagram illustrating an example of an encoding target image. Regarding the prediction block size according to the first embodiment, as shown in FIG. 2, the encoding target image is encoded in units of 64 × 64 pixel encoding blocks (CU), and the prediction block is further divided into encoding blocks. Unit. The maximum prediction block size is 64 × 64 pixels, which is the same as the encoded block, and the minimum prediction block size is 4 × 4 pixels. The coding block is divided into prediction blocks: non-division (2N × 2N), horizontal / vertical division (N × N), horizontal only division (2N × N), and vertical division only (N × 2N) is possible. Only in the case of horizontal and vertical division, the further divided prediction block can be divided into prediction blocks hierarchically as encoded blocks, and the hierarchy is expressed by the number of CU divisions.

  FIG. 3 is a diagram showing a detailed definition of the predicted block size. There are 13 predicted block sizes from 64 pixels × 64 pixels, which is the maximum predicted block size with 0 CU divisions, to 4 pixels × 4 pixels, which is the minimum predicted block size with 3 CU partitions. Will exist.

  Regarding the division | segmentation structure of the prediction block which concerns on Embodiment 1 of this invention, it is not limited to this combination. In addition, the selection of the prediction block size in the moving image encoding apparatus can adaptively select a structure with better encoding efficiency in units of encoding blocks, but the first embodiment is in units of prediction blocks. Since attention is paid to inter-frame prediction and inter-frame motion information encoding, the components and description relating to selection of the optimal prediction block size are omitted. Regarding the subsequent operation of the video encoding apparatus, the operation performed in units of the selected prediction block size will be described.

  Returning to FIG. 1, the subtraction unit 101 subtracts the image signal supplied from the input terminal 100 and the prediction signal supplied from the prediction mode determination unit 109 to calculate a prediction error signal, and orthogonally transforms / quantizes the prediction error signal. To the conversion unit 102.

  The orthogonal transform / quantization unit 102 performs orthogonal transform and quantization on the prediction error signal supplied from the subtraction unit 101, and the quantized prediction error signal is subjected to a prediction error encoding unit 103 and an inverse quantization / inverse conversion unit. 104 is supplied.

  The prediction error encoding unit 103 entropy-encodes the quantized prediction error signal supplied from the orthogonal transform / quantization unit 102, generates a code string for the prediction error signal, and supplies the code sequence to the multiplexing unit 112 .

  The inverse quantization / inverse transform unit 104 performs processing such as inverse quantization and inverse orthogonal transform on the quantized prediction error signal supplied from the orthogonal transform / quantization unit 102, and outputs the decoded prediction error signal. Generated and supplied to the adding unit 105.

  The addition unit 105 adds the decoded prediction error signal supplied from the inverse quantization / inverse conversion unit 104 and the prediction signal supplied from the prediction mode determination unit 109, generates a decoded image signal, and outputs the decoded image signal. The decoded image memory 116 is supplied.

  The decoded image memory 106 stores the decoded image signal supplied from the adding unit 105. In addition, a decoded image for which decoding of the entire image has been completed is stored as a reference image by a predetermined number of images, and the reference image signal is supplied to the motion vector detection unit 107 and the motion compensation prediction unit 108.

  The motion vector detection unit 107 receives the prediction block image signal supplied from the input terminal 100 and the reference image signal stored in the decoded image memory 106, detects the motion vector for each reference image, and detects the motion vector. The value is supplied to the prediction mode determination unit 109.

  A general motion vector detection method calculates an error evaluation value for an image signal corresponding to a reference image moved by a predetermined movement amount from the same position as the image signal, and moves the movement amount that minimizes the error evaluation value. Let it be a vector. As the error evaluation value, a sum of absolute differences SAD (Sum of Absolute Difference) for each pixel, a sum of square error values SSE (Sum of Square Error) for each pixel, or the like is used. Furthermore, the code amount related to the coding of the motion vector can also be included in the error evaluation value.

  The motion compensated prediction unit 108 predicts the reference image indicated by the reference image designation information in the decoded image memory 106 by a motion vector value according to the reference image designation information designated by the prediction mode determination unit 109 and the motion vector value. An image signal at a position moved from the same position as the image signal is acquired to generate a prediction signal.

  When the prediction mode specified by the prediction mode determination unit 109 is uni-prediction, a prediction signal acquired from one reference image is used as a motion-compensated prediction signal. When the prediction mode is bi-prediction, two reference images are used. A weighted average of the obtained prediction signals is used as a motion compensation prediction signal, and the motion compensation prediction signal is supplied to the prediction mode determination unit 109. Here, the ratio of the weighted average of bi-prediction is set to 1: 1.

  4A to 4D are diagrams for explaining the prediction type of motion compensation prediction. The process of performing prediction from a single reference image is defined as single prediction. In the case of single prediction, one of reference images registered in two reference image management lists, L0 prediction and L1 prediction, is used.

  FIG. 4A shows a case of single prediction and the reference image (RefL0Pic) for L0 prediction is at a time before the encoding target image (CurPic). FIG. 4B shows a case in which the prediction image is a single prediction and the reference image of the L0 prediction is at a time after the encoding target image. Similarly, the L0 prediction reference image shown in FIGS. 4A and 4B can be replaced with the L1 prediction reference image (RefL1Pic) to perform single prediction.

  The process of performing prediction from two reference images is defined as bi-prediction. In the case of bi-prediction, both L0 prediction and L1 prediction are used to represent BI prediction. FIG. 4C illustrates a case where bi-prediction is performed, and the reference image for L0 prediction is at a time before the encoding target image and the reference image for L1 prediction is at a time after the encoding target image. . FIG. 4D shows a case of bi-prediction, where the reference image for L0 prediction and the reference image for L1 prediction are at a time before the encoding target image. As described above, the relationship between the prediction type of L0 / L1 and time can be used without being limited to L0 being the past direction and L1 being the future direction.

  Returning to FIG. 1, the prediction mode determination unit 109 detects the motion vector value detected for each reference image input from the motion vector detection unit 107 and the motion information stored in the motion information memory 111 (prediction type, motion Based on the vector value and the reference image designation information), the reference image designation information and the motion vector value used for each of the motion compensation prediction modes defined in the first embodiment are set in the motion compensation prediction unit 108. . Based on the set value, an optimal motion compensation prediction mode is determined using the motion compensation prediction signal supplied from the motion compensation prediction unit 108 and the image signal of the prediction block supplied from the input terminal 100.

  The prediction mode determination unit 109 supplies information that identifies the determined prediction mode and the prediction type, motion vector, and reference image designation information corresponding to the prediction mode to the motion information encoding unit 110, and determines the determined prediction mode and A prediction type, a motion vector value, and reference image designation information for the prediction mode are supplied to the motion information memory 111, and a prediction signal corresponding to the determined prediction mode is supplied to the subtraction unit 101 and the addition unit 105.

  In the moving image encoding apparatus, intra-frame prediction is performed in which prediction is performed using an encoded image in the same screen in order to encode a reference image as a reference. Embodiment 1 focuses on inter-screen prediction. Therefore, the components related to the intra prediction are omitted. A detailed configuration of the prediction mode determination unit 109 will be described later.

  The motion information encoding unit 110 encodes the prediction mode supplied from the prediction mode determination unit 109 and information specifying the prediction type, the motion vector, and the reference image designation information according to the prediction mode according to a predetermined syntax structure. Thus, a code string of motion information is generated and supplied to the multiplexing unit 112.

  The motion information memory 111 stores motion information (prediction type, motion vector, and reference image index) supplied from the prediction mode determination unit 109 for a predetermined image on the basis of the minimum prediction block size unit. The motion information of the adjacent block of the prediction block to be processed is set as a spatial candidate block group, and the motion information of the block on the ColPic at the same position as the prediction block to be processed and its neighboring blocks is set as the time candidate block group.

  ColPic is a decoded image different from the prediction block to be processed, and is stored in the decoded image memory 106 as a reference image. In Embodiment 1, ColPic is a reference image decoded immediately before. In the first embodiment, ColPic is the reference image decoded immediately before, but the reference image immediately before in display order or the reference image immediately after in display order may be used, and the reference image used for ColPic is included in the encoded stream. Direct specification is also possible.

  The motion information memory 111 supplies the motion information of the spatial candidate block group and the temporal candidate block group to the prediction mode determination unit 109 as motion information of the candidate block group. The multiplexing unit 112 multiplexes the prediction error encoded sequence supplied from the prediction error encoding unit 103 and the motion information encoded sequence supplied from the motion information encoding unit 110 to encode the encoded bit stream. And the encoded bit stream is output to the recording medium / transmission path via the output terminal 113.

  The configuration of the moving picture encoding apparatus shown in FIG. 1 can also be realized by hardware such as an information processing apparatus including a CPU (Central Processing Unit), a frame memory, and a hard disk.

  FIG. 5 is a flowchart showing the flow of the encoding process in the video encoding apparatus according to Embodiment 1 of the present invention. A prediction block image to be processed is acquired from the input terminal 100 for each prediction block unit (S500). The motion vector detection unit 107 calculates a motion vector value for each reference image from the prediction block image to be processed and a plurality of reference images stored in the decoded image memory 106 (S501).

  Subsequently, the prediction mode determination unit 109 uses each of the motion vectors supplied from the motion vector detection unit 107 and the motion information stored in the motion information memory 111 to each of the motion compensation prediction modes defined in the first embodiment. Is obtained using the motion compensation prediction unit 108, an optimal prediction mode is selected, and a prediction signal is generated (S502). Details of the processing in step S502 will be described later.

  Subsequently, the subtraction unit 101 calculates a difference between the prediction block image to be processed and the prediction signal supplied from the prediction mode determination unit 109 as a prediction error signal (S503). The motion information encoding unit 110 encodes the prediction mode supplied from the prediction mode determination unit 109 and information specifying the prediction type, the motion vector, and the reference image designation information according to the prediction mode according to a predetermined syntax structure. Then, encoded data of motion information is generated (S504).

  Subsequently, the prediction error encoding unit 103 entropy encodes the quantized prediction error signal generated by the orthogonal transform / quantization unit 102 to generate encoded data of the prediction error (S505). The multiplexing unit 112 multiplexes the motion information encoded data supplied from the motion information encoding unit 110 and the prediction error encoded data supplied from the prediction error encoding unit 103 to generate an encoded bitstream. (S506).

  The adding unit 105 adds the decoded prediction error signal supplied from the inverse quantization / inverse transform unit 104 and the prediction signal supplied from the prediction mode determination unit 109 to generate a decoded image signal (S507). The generated decoded image signal is supplied to and stored in the decoded image memory 106 by the adding unit 105, and is used for motion compensation prediction processing of an encoded image to be encoded later (S508). The motion information memory 111 stores the motion information (prediction type, motion vector, and reference image designation information) supplied from the motion vector detection unit 107 in units of the minimum predicted block size (S509).

[Overall configuration of video decoding apparatus]
FIG. 6 is a diagram showing a configuration of the moving picture decoding apparatus according to Embodiment 1 of the present invention. Hereinafter, the operation of each unit will be described. The video decoding apparatus according to Embodiment 1 includes an input terminal 600, a demultiplexing unit 601, a prediction difference information decoding unit 602, an inverse quantization / inverse transformation unit 603, an addition unit 604, a decoded image memory 605, and a motion information decoding unit. 606, a motion information memory 607, a motion compensation prediction unit 608, and an output terminal 609.

  The encoded bit stream is supplied from the input terminal 600 to the demultiplexing unit 601. The demultiplexing unit 601 specifies the code sequence of the supplied encoded bitstream, the encoded sequence of prediction error information, the prediction mode, the prediction type according to the prediction mode, the motion vector, and the reference image designation information Are separated into motion information encoded sequences. The encoded sequence of the prediction error information is supplied to the prediction difference information decoding unit 602, and the encoded sequence of the motion information is supplied to the motion information decoding unit 606.

  The prediction difference information decoding unit 602 decodes the encoded sequence of the prediction error information supplied from the demultiplexing unit 601 and generates a quantized prediction error signal. The prediction difference information decoding unit 602 supplies the generated quantized prediction error signal to the inverse quantization / inverse transform unit 603.

  The inverse quantization / inverse transform unit 603 performs a process such as inverse quantization or inverse orthogonal transform on the quantized prediction error signal supplied from the prediction difference information decoding unit 602 to generate a prediction error signal, and performs decoding prediction. The error signal is supplied to the adding unit 604.

  The adder 604 adds the decoded prediction error signal supplied from the inverse quantization / inverse transform unit 603 and the prediction signal supplied from the motion compensation prediction unit 608 to generate a decoded image signal, and decodes the decoded image signal This is supplied to the image memory 605.

  The decoded image memory 605 has the same function as the decoded image memory 106 in the moving image encoding apparatus in FIG. 1, stores the decoded image signal supplied from the addition unit 604, and stores the reference image signal in the motion compensation prediction unit 608. Supply. Also, the decoded image memory 605 supplies the stored decoded image signal to the output terminal 609 in accordance with the image display order in accordance with the reproduction time.

  The motion information decoding unit 606 obtains information specifying the prediction mode, the prediction type corresponding to the prediction mode, the motion vector, and the reference image designation information from the motion information encoded sequence supplied from the demultiplexing unit 601. Decrypt as Based on the decoded motion information and the motion information of the candidate block group supplied from the motion information memory 607, the prediction type, motion vector, and reference image designation information used for motion compensation prediction are reproduced and supplied to the motion compensation prediction unit 608. In addition, the motion information decoding unit 606 supplies the reproduced motion information to the motion information memory 607. A detailed configuration of the motion information decoding unit 606 will be described later.

  The motion information memory 607 has the same function as that of the motion information memory 111 in the video encoding apparatus of FIG. 1, and reproduces the reproduced motion information supplied from the motion information decoding unit 606 for a predetermined image on the basis of the minimum prediction block size unit. Remember. Also, the motion information memory 607 supplies the motion information of the space candidate block group and the time candidate block group to the motion information decoding unit 606 as motion information of the candidate block group.

  The motion compensation prediction unit 608 has the same function as that of the motion compensation prediction unit 108 in the video encoding apparatus in FIG. 1, and based on the motion information supplied from the motion information decoding unit 606, a reference image in the decoded image memory 605. A prediction signal is generated by acquiring an image signal at a position obtained by moving the reference image indicated by the designation information from the same position as the image signal of the prediction block by the motion vector value. If the prediction type of motion compensation prediction is bi-prediction, an average of the prediction signals of each prediction type is generated as a prediction signal, and the prediction signal is supplied to the adding unit 604.

  The output terminal 609 reproduces a decoded image signal by outputting the decoded image signal supplied from the decoded image memory 605 to a display medium such as a display.

  The configuration of the video decoding device shown in FIG. 6 can also be realized by hardware such as an information processing device including a CPU, a frame memory, a hard disk, etc., similarly to the configuration of the video encoding device shown in FIG. is there.

  FIG. 7 is a flowchart showing a flow of decoding processing in the video decoding apparatus according to Embodiment 1 of the present invention. The demultiplexing unit 601 separates the coded bit stream supplied from the input terminal 600 into a coded sequence of prediction error information and a coded sequence of motion information (S700). The separated coded sequence of motion information is supplied to the motion information decoding unit 606, and the motion information of the decoding target block is decoded using the motion information of the candidate block group supplied from the motion information memory 607 (S701). Details of the processing in step S701 will be described later.

  The separated coded sequence of prediction error information is supplied to the prediction difference information decoding unit 602, decoded as a quantized prediction error signal, and dequantized or inverse orthogonal transformed by an inverse quantization / inverse transformation unit 603. By performing the above process, a decoded prediction error signal is generated (S702).

  The motion information decoding unit 606 supplies the motion information of the decoding target block to the motion compensation prediction unit 608, and the motion compensation prediction unit 608 performs motion compensation prediction according to the motion information to calculate a prediction signal (S703). The adding unit 604 adds the decoded prediction error signal supplied from the inverse quantization / inverse transform unit 603 and the prediction signal supplied from the motion compensation prediction unit 608 to generate a decoded image signal (S704).

  The decoded image signal supplied from the adding unit 604 is stored in the decoded image memory 605 (S705), and the motion information of the decoding target block supplied from the motion information decoding unit 606 is stored in the motion information memory 607 ( S706). This completes the decoding process in units of prediction blocks.

[Detailed Function Description of Embodiment 1]
The operation of the prediction mode determination unit 109 of the video encoding device according to Embodiment 1 of the present invention, the process of Step S502 in the flowchart of FIG. 5, and the motion information in the video decoding device of Embodiment 1 of the present invention The operation of the decoding unit 606 and the detailed operation of the process of step S701 in the flowchart of FIG. 7 will be described below.

[Definition of Motion Compensation Prediction Mode in Embodiment 1]
FIGS. 8A and 8B are diagrams for explaining two prediction modes for encoding motion information used in motion compensated prediction according to Embodiment 1 of the present invention. In the first prediction mode, the prediction target block directly encodes its own motion information using the continuity of motion in the temporal direction and the spatial direction in the prediction target block and the encoded block adjacent to the prediction target block. In this method, the motion information of spatially and temporally adjacent blocks is used for encoding, which is called a joint prediction mode (merge mode).

  In the first prediction mode, the prediction target block directly encodes its own motion information using the continuity of motion in the temporal direction and the spatial direction in the prediction target block and the encoded block adjacent to the prediction target block. In this method, the motion information of spatially and temporally adjacent blocks is used for encoding, which is called a joint prediction mode (merge mode).

  Here, spatially adjacent blocks indicate blocks adjacent to the prediction target block among the encoded blocks belonging to the same image as the prediction target block. Here, the temporally adjacent blocks indicate blocks in the same spatial position as the prediction target block and in the vicinity thereof among blocks belonging to an encoded image different from the prediction target block.

  In the combined prediction mode, motion information that is selectively combined from a plurality of adjacent block candidates can be defined, and the motion information is encoded with information (index) that specifies the adjacent block to be used. The obtained motion information is used as it is for motion compensation prediction. Further, in the joint prediction mode, a Skip mode is defined in which the prediction signal predicted in the joint prediction mode is a decoded picture without encoding prediction transmission of the prediction difference information, and a decoded image is obtained with information having only the combined motion information. Can be reproduced. The motion information transmitted in the Skip mode is designation information that defines adjacent blocks, as in the combined prediction mode.

  The second prediction mode is a technique for individually coding all the components of motion information and transmitting motion information with little prediction error to the prediction block, and is called a motion detection prediction mode. In the motion detection prediction mode, information for specifying a reference image (reference image index) and information for specifying a motion vector are encoded separately, as in the case of encoding motion information in conventional motion compensation prediction. The

  In the motion detection prediction mode, the prediction mode indicates whether to use single prediction or bi-prediction. In the case of single prediction single prediction, information for specifying a reference image for one reference image, and a motion vector prediction vector The difference vector is encoded. In the case of bi-prediction, information for specifying reference images for two reference images and a motion vector are individually encoded. The prediction vector for the motion vector is generated from the motion information of the adjacent block similarly to the AVC. However, similarly to the combined prediction mode, the motion vector used for the prediction vector can be selected from a plurality of adjacent block candidates, and the motion vector is the prediction vector. The information is transmitted by encoding two pieces of information (index) for designating adjacent blocks to be used for and a difference vector.

[Detailed Operation Description of Prediction Mode Determination Unit in Moving Picture Encoding Device in Embodiment 1]
FIG. 9 is a diagram illustrating a detailed configuration of the prediction mode determination unit 109 in the video encoding apparatus according to Embodiment 1. The prediction mode determination unit 109 has a function of determining an optimal motion compensation prediction mode.

  The prediction mode determination unit 109 includes a motion compensation prediction generation unit 900, a prediction error calculation unit 901, a prediction vector calculation unit 902, a difference vector calculation unit 903, a motion information code amount calculation unit 904, a prediction mode evaluation unit 905, and a combined motion information calculation. A combined motion compensation prediction generation unit 907.

  1, the motion vector value input from the motion vector detection unit 107 is supplied to the motion compensation prediction generation unit 900, and the motion information input from the motion information memory 111 is the prediction vector. The calculation unit 902 and the combined motion information calculation unit 906 are supplied.

  Also, the motion compensation prediction generation unit 900 and the combined motion compensation prediction generation unit 907 output reference image designation information and motion vectors used for motion compensation prediction to the motion compensation prediction unit 108, and the motion compensation prediction unit 108. Thus, the generated motion compensated prediction image is supplied to the prediction error calculation unit 901. The prediction error calculation unit 901 is further supplied with an image signal of a prediction block to be encoded from the input terminal 100.

  Also, the motion information encoding unit 110 is supplied with motion information to be encoded and the determined prediction mode information from the prediction mode evaluation unit 905, the motion information is supplied to the motion information memory 111, and the motion compensated prediction signal is subtracted. To the unit 101 and the addition unit 105.

  The motion compensation prediction generation unit 900 receives the motion vector value calculated for each reference image that can be used for prediction, supplies reference image designation information to the prediction vector calculation unit 902, and the reference image designation information and the motion vector Is output.

  The prediction error calculation unit 901 calculates a prediction error evaluation value from the input motion compensated prediction image and the prediction block image to be processed. As the calculation for calculating the error evaluation value, the sum SAD of the absolute difference value for each pixel, the sum SSE of the square error value for each pixel, and the like can be used as in the error evaluation value in motion vector detection. Furthermore, a more accurate error evaluation value can be calculated by taking into account the amount of distortion components generated in the decoded image by performing orthogonal transform / quantization performed when encoding the prediction residual. . In this case, the prediction error calculation unit 901 can be realized by having the functions of the subtraction unit 101, the orthogonal transformation / quantization unit 102, the inverse quantization / inverse transformation unit 104, and the addition unit 105 in FIG.

  The prediction error calculation unit 901 supplies the prediction error evaluation value calculated in each prediction mode and the motion compensation prediction signal to the prediction mode evaluation unit 905.

  The prediction vector calculation unit 902 is supplied with the reference image designation information from the motion compensation prediction generation unit 900, and the motion vector value for the designated reference image from the candidate block group in the motion information of the adjacent block supplied from the motion information memory 111. Are generated together with the prediction vector candidate list, and supplied to the difference vector calculation unit 903 together with the reference image designation information. The prediction vector calculation unit 902 creates prediction vector candidates and registers them as prediction vector candidates.

  The difference vector calculation unit 903 calculates the difference between each of the prediction vector candidates supplied from the prediction vector calculation unit 902 and the motion vector value supplied from the motion compensated prediction generation unit 900, and calculates the difference vector value. calculate. When the prediction vector index which is the designation information for the calculated difference vector value and the prediction vector candidate is encoded, the code amount is the smallest. The difference vector calculation unit 903 supplies the prediction vector index and the difference vector value for the prediction vector having the smallest information amount, together with the reference image designation information, to the motion information code amount calculation unit 904.

  The motion information code amount calculation unit 904 calculates the code amount required for motion information in each prediction mode from the difference vector value, reference image designation information, prediction vector index, and prediction mode supplied from the difference vector calculation unit 903. . Also, the motion information code amount calculation unit 904 receives information indicating the combined motion information index and the prediction mode that need to be transmitted in the combined prediction mode from the combined motion compensation prediction generation unit 907, and performs motion in the combined prediction mode. The amount of code required for information is calculated.

  The motion information code amount calculation unit 904 supplies the motion information calculated in each prediction mode and the code amount required for the motion information to the prediction mode evaluation unit 905.

  The prediction mode evaluation unit 905 uses the prediction error evaluation value of each prediction mode supplied from the prediction error calculation unit 901 and the motion information code amount of each prediction mode supplied from the motion information code amount calculation unit 904. An overall motion compensation prediction error evaluation value for the prediction mode is calculated, a prediction mode having the smallest evaluation value is selected, motion information for the selected prediction mode and the selected prediction mode, a motion information encoding unit 110, a motion information memory To 111. Similarly, the prediction mode evaluation unit 905 selects a prediction signal in the selected prediction mode for the motion compensated prediction signal supplied from the prediction error calculation unit 901 and outputs it to the subtraction unit 101 and the addition unit 105.

  The combined motion information calculation unit 906 uses a candidate block group in the motion information of the adjacent blocks supplied from the motion information memory 111, a prediction type indicating whether it is uni-prediction or bi-prediction, reference image designation information, motion A plurality of pieces of motion information are generated together with the combined motion information candidate list as motion information composed of vector values, and supplied to the combined motion compensation prediction generation unit 907.

  FIG. 10 is a diagram illustrating a configuration of the combined motion information calculation unit 906. The combined motion information calculation unit 906 includes a spatial combined motion information candidate list generation unit 1000, a combined motion information candidate list deletion unit 1001, a temporal combined motion information candidate list generation unit 1002, a first combined motion information candidate list addition unit 1003, and a second. A combined motion information candidate list adding unit 1004 is included. The combined motion information calculation unit 906 creates motion information candidates in a predetermined order from spatially adjacent candidate block groups, deletes candidates having the same motion information from the candidates, and then temporally adjacent. By adding motion information candidates created from the candidate block group, only valid motion information is registered as combined motion information candidates. The point that this temporally combined motion information candidate list generation unit is arranged after the combined motion information candidate list deletion unit is a characteristic configuration of the present embodiment, and deletes the same motion information from temporally combined motion information candidates. By eliminating the processing target, it is possible to reduce the amount of calculation without reducing the encoding efficiency. The detailed operation of the combined motion information calculation unit 906 will be described later.

  Returning to FIG. 9, the combined motion compensation prediction generation unit 907 determines, based on the motion information, the prediction type for each registered combined motion information candidate from the combined motion information candidate list supplied from the combined motion information calculation unit 906. In accordance with the reference image designation information and motion vector value of one reference image (uni-prediction) or two reference images (bi-prediction), the motion compensated prediction unit 108 is designated to generate a motion compensated prediction image, The combined motion information index is supplied to the motion information code amount calculation unit 904.

  In the configuration of FIG. 9, the prediction mode evaluation for each combined motion information index is performed by the prediction mode evaluation unit 905. The prediction error evaluation value and the motion information code amount are calculated by the prediction error calculation unit 901 and the motion information code amount calculation. In the combined motion compensated prediction generation unit 907, the optimal combined motion index of the optimal combined motion compensated prediction is determined and then the optimal prediction mode including other prediction modes is evaluated. Is possible.

  FIG. 11 is a flowchart for explaining detailed operations of the motion compensation prediction mode / prediction signal generation processing in step S502 of FIG. This operation shows the detailed operation in the prediction mode determination unit 109 of FIG.

  First, a combined motion information candidate list is generated (S1100), and a combined prediction mode evaluation value is generated (S1101). Subsequently, a prediction mode evaluation value is generated (S1102), and the optimal evaluation mode is selected by comparing the generated evaluation values (S1103). However, the order of evaluation value generation in steps S1101 and S1102 is not limited to this.

  A prediction signal is output in accordance with the selected prediction mode (S1104), and motion information is output in accordance with the selected prediction mode (S1105), thereby completing the motion compensation prediction mode / prediction signal generation process for each prediction block. Detailed operations in steps S1100, S1101, and S1102 will be described later.

  FIG. 12 is a flowchart for explaining the detailed operation of generating the combined motion information candidate list in step S1100 of FIG. This operation shows the detailed operation of the configuration in the combined motion information calculation unit 906 in FIG.

  The spatially coupled motion information candidate list generation unit 1000 in FIG. 10 performs spatially coupled motion from candidate blocks excluding candidate blocks outside the region or candidate blocks in the intra mode from the spatial candidate block group supplied from the motion information memory 111. An information candidate list is generated (S1200). Detailed operations for generating the spatially coupled motion information candidate list will be described later.

  Subsequently, the combined motion information candidate list deletion unit 1001 deletes the combined motion information candidate having the same motion information from the generated spatial combined motion information candidate list and updates the motion information candidate list (S1201). Detailed operation of the combined motion information candidate deletion will be described later.

  The temporally combined motion information candidate list generation unit 1002 subsequently extracts temporally combined motion information from candidate blocks excluding candidate blocks outside the region from the temporal candidate block group supplied from the motion information memory 111 and candidate blocks that are in the intra mode. A candidate list is generated (S1202) and combined with the temporally combined motion information candidate list to form a combined motion information candidate list. Detailed operation of the time combination motion information candidate list generation will be described later.

  Next, the first combined motion information candidate list adding unit 1003 outputs 0 to 4 first combined motion information candidates registered in the combined motion information candidate list generated by the temporal combined motion information candidate list generating unit 1002. A supplementary combined motion information candidate is generated and added to the combined motion information candidate list (S1203), and the combined motion information candidate list is supplied to the second combined motion information candidate list adding unit 1004. The detailed operation of adding the first combined motion information candidate list will be described later.

  Next, the second combined motion information candidate list adding unit 1004 includes 0 to 2 second supplemental combined motion information candidates that do not depend on the combined motion information candidate list supplied from the first combined motion information candidate list adding unit 1003. Is added to the combined motion information candidate list supplied from the first combined motion information candidate list adding unit 1003 (S1204), and the process ends. Detailed operations for adding the second combined motion information candidate list will be described later.

  The candidate block group of motion information supplied from the motion information memory 111 to the combined motion information calculation unit 906 includes a spatial candidate block group and a temporal candidate block group. First, generation of a spatially coupled motion information candidate list will be described.

  FIG. 13 is a diagram illustrating a spatial candidate block group used for generating a spatially coupled motion information candidate list. The spatial candidate block group indicates a block of the same image adjacent to the prediction target block of the encoding target image. The block group is managed in units of the minimum prediction block size, and the position of the candidate block is managed in units of the minimum prediction block size, but when the prediction block size of the adjacent block is larger than the minimum prediction block size The same motion information is stored in all candidate blocks within the predicted block size. In the first embodiment, among the adjacent block groups, five blocks of block A0, block A1, block B0, block B1, and block B2 as shown in FIG. 13 are set as space candidate block groups.

  FIG. 14 is a flowchart for explaining the detailed operation of generating the spatially coupled motion information candidate list. Of the five candidate blocks included in the spatial candidate block group, the following processing is repeated for block A0, block A1, block B0, block B1, and block B2 in the order of block A1, block B1, block B0, and block A0. (S1400 to S1403).

  First, the validity of the candidate block is checked (S1401). If the candidate block is not out of the region and not in the intra mode, the candidate block is valid. If the candidate block is valid (S1401: YES), the motion information of the candidate block is added to the spatially combined motion information candidate list (S1402).

  Following the repetitive processing from step S1400 to S1403, when the number of candidates added to the spatial combination motion information candidate list is less than 4 (S1404: YES), the validity of the candidate block B2 is checked (S1405). When the block B2 is not out of the region and is not in the intra mode (S1405: YES), the motion information of the block B2 is added to the spatially coupled motion information candidate list (S1406).

  Here, it is assumed that the spatial combination motion information candidate list includes motion information of four or less candidate blocks, but the spatial candidate block group is at least one or more processed blocks adjacent to the prediction block to be processed. The number of spatially coupled motion information candidate lists may be changed depending on the effectiveness of the candidate block, and the present invention is not limited to this.

  FIG. 15 is a flowchart for explaining the detailed operation of combined motion information candidate deletion. Assuming that the maximum number of combined motion information candidates generated by the spatial combined motion information candidate list creation process is Max Spatial Cand, the following is performed for combined motion information candidates (candidate (i)) from i = Max Spatial Cand-1 to i> 0. These processes are repeated (S1500 to S1506).

  If the candidate (i) exists (YES in S1501), the following processing is repeated for the combined motion information candidates (candidate (ii)) from ii = i-1 to ii> = 0 (S1502 to S1502). S1505) If the candidate (i) does not exist (NO in S1501), the iterative process for the candidate (ii) from step S1502 to S1505 is skipped.

  First, whether the motion information (motion information (i)) of the candidate (i) and the motion information (motion information (ii)) of the candidate (ii) are the same is checked (S1503), and if they are the same (YES in S1503) ), Candidate (i) is deleted from the combined motion information candidate list (S1504), and the iterative process for candidate (ii) ends.

  When the motion information (i) and the motion information (ii) are not the same (NO in S1503), 1 is subtracted from ii, and the process for the candidate (ii) is repeated (S1502 to S1505).

  Subsequent to the repetitive processing from steps S1500 to S1505, 1 is subtracted from i, and the processing for candidate (i) is repeated (S1500 to S1506).

  FIG. 16 shows a comparison relationship of candidates in the list when there are four combined motion information candidates. That is, four spatially combined motion information candidates that do not include temporally combined motion information candidates are compared by brute force to determine identity, and duplicate candidates are deleted.

  Here, the joint prediction mode uses temporal and spatial continuity of motion, and the prediction target block encodes motion information of spatially and temporally adjacent blocks without directly encoding its own motion information. Although the spatially coupled motion information candidate is based on continuity in the spatial direction, the temporally coupled motion information candidate is generated by the method described later based on the temporal direction continuity. These properties are different. Therefore, it is rare that the same motion information is included in the temporally combined motion information candidate and the spatially combined motion information candidate, and the temporally combined motion information candidate is removed from the target of the combined motion information candidate deletion process for deleting the same motion information. Even if they are excluded, it is rare that the same motion information is included in the finally obtained combined motion information candidate list.

  Also, as will be described later, temporally combined motion information candidate blocks are managed in units of minimum spatial prediction blocks having a size larger than that of the minimum prediction block, so that the size of the temporally adjacent prediction blocks is larger than that of the minimum spatial prediction block. If it is small, motion information at a position deviating from the original position is used, and as a result, the motion information often includes an error. Therefore, the motion information is often different from the motion information of the spatially coupled motion information candidate, and there is little influence even if the motion information is excluded from the target of the combined motion information candidate deletion process for deleting the same motion information.

  FIG. 17 is an example of comparison contents of candidates in deletion of combined motion information candidates when the maximum number of spatially combined motion information candidates is four. FIG. 17A shows the comparison contents when only the spatially coupled motion information candidate is the target of the coupled motion information candidate deletion process, and FIG. 17B is the target of processing the spatially coupled motion information candidate and the temporally coupled motion information. It is a comparison content in the case of. By using only the spatially combined motion information candidates as the target of the combined motion information candidate deletion process, the number of comparisons of motion information is reduced from 10 times to 6 times.

  Thus, by not deleting the temporally combined motion information candidate as the target of the combined motion information candidate deletion process, the number of motion information comparisons is reduced from 10 to 6 while appropriately deleting the same motion information. Is possible.

  Subsequently, generation of a time combination motion information candidate list will be described. FIG. 18 is a diagram illustrating the definition of the temporal direction peripheral prediction block used for generating the temporally combined motion information candidate list. The temporal candidate block group indicates blocks in the same position as and around the prediction target block among the blocks belonging to the decoded image ColPic different from the image to which the prediction target block belongs. The block group is managed in units of the minimum spatial prediction block size, and the position of the candidate block is managed in units of the minimum spatial prediction block size. In Embodiment 1 of the present invention, the minimum spatial prediction block size is set to a size obtained by doubling the minimum prediction block size in the vertical and horizontal directions. When the size of the prediction block of temporally adjacent blocks is larger than the minimum spatial prediction block size, the same motion information is stored in all candidate blocks within the prediction block size. On the other hand, when the size of the prediction block is smaller than the minimum spatial prediction block size, the motion information of the prediction block located at the upper left of the temporal direction peripheral prediction block is used as the temporal direction peripheral prediction block information. FIG. 18B shows motion information of the temporal direction neighboring prediction block when the prediction block size is smaller than the minimum spatial prediction block size.

  Blocks at positions A1 to A4, B1 to B4, C, D, E, F1 to F4, G1 to G4, H, and I1 to I16 in FIG. 18A are temporally adjacent block groups. In the first embodiment, among these temporally adjacent block groups, the temporal candidate block group is assumed to be two blocks, block H and block I6.

FIG. 19 is a flowchart for explaining the detailed operation of generating the time combination motion information candidate list. Regarding the block H and the block I6 which are two candidate blocks included in the time candidate block group (S1800, S1805), the validity of the candidate block is checked in the order of the block H and the block I6 (S1801). If the candidate block is valid (S1801: YES), the processing of step S1802 to step S1804 is performed, the generated motion information is registered in the time combination motion information candidate list, and the processing ends. When the candidate block indicates a position outside the screen area, or when the candidate block is an intra prediction block (S1801: NO), the candidate block is not valid, and valid / invalid determination of the next candidate block is performed.
If the candidate block is valid (S1801: YES), the reference image selection candidate to be registered in the combined motion information candidate is determined based on the motion information of the candidate block (S1802). In the first embodiment, the L0 prediction reference image is the reference image that is the closest to the processing target image among the L0 prediction reference images, and the L1 prediction reference image is the processing target image among the L1 prediction reference images. The reference image is the closest distance.

  The determination method of the reference image selection candidate here is not limited to this as long as the reference image for L0 prediction and the reference image for L1 prediction can be determined. The reference image intended at the time of encoding can be determined by determining the reference image by the same method in the encoding process and the decoding process. As another determination method, for example, a method of selecting a reference image having a reference image index of 0 for a reference image for L0 prediction and a reference image for L1 prediction, or a L0 reference image and a L1 reference image used by spatially neighboring blocks. Thus, it is possible to use a method of selecting the most frequently used reference image as a reference image in the prediction target block, or a method of specifying a reference image of each prediction type in the encoded stream.

  Next, a motion vector value to be registered in the combined motion information candidate is determined based on the motion information of the candidate block (S1803). In the first embodiment, the temporally coupled motion information calculates bi-prediction motion information based on motion vector values that are effective prediction types in motion information of candidate blocks. When the prediction type of the candidate block is L0 prediction or L1 prediction single prediction, motion information of the prediction type (L0 prediction or L1 prediction) used for prediction is selected, and its reference image designation information and motion vector value are selected. Is a reference value for generating bi-predictive motion information.

  If the prediction type of the candidate block is bi-prediction, motion information of either L0 prediction or L1 prediction is selected as a reference value. The selection method of the reference value is, for example, selecting motion information that exists in the same prediction type as ColPic, selecting the reference image of the candidate block that has a shorter inter-image distance from ColPic in the L0 prediction and L1 prediction, or For example, it is possible to select a direction in which the motion vectors of the L0 prediction and the L1 prediction of the candidate block intersect with the encoding process target image.

  When the motion vector value used as a reference for bi-predictive motion information generation is determined, a motion vector value to be registered in the combined motion information candidate is calculated.

  FIG. 20 is a diagram for explaining a calculation method of motion vector values mvL0t and mvL1t registered for L0 prediction and L1 prediction with respect to the reference motion vector value ColMv for temporally coupled motion information.

The distance between images between ColPic for the reference motion vector value ColMv and the reference image that is the target of the motion vector used as a reference for the candidate block is referred to as ColDist. The inter-image distance between each reference image of L0 prediction and L1 prediction and the processing target image is set to CurrL0Dist and CurrL1Dist. A motion vector obtained by scaling ColMv with a distance ratio of ColDist to CurrL0Dist and CurrL1Dist is set as a motion vector to be registered. Specifically, the motion vector values mvL0t and mvL1t to be registered are calculated by the following formulas 1 and 2.
mvL0t = mvCol × CurrL0Dist / ColDist (Formula 1)
mvL1t = mvCol × CurrL1Dist / ColDist (Formula 2)
It becomes.

  Returning to FIG. 19, the bi-predicted reference image selection information (index) and the motion vector value generated in this way are added to the combined motion information candidates (S1804), and the temporal combined motion information candidate list creation process ends. To do.

Next, a detailed operation of the first combined motion information candidate list adding unit 1003 will be described. FIG. 21 is a flowchart for explaining the operation of the first combined motion information candidate list adding unit 1003. First, from the number of combined motion information candidates (NumCandList) and the maximum number of combined motion information candidates (MaxNumMergeCand) registered in the combined motion information candidate list supplied from the temporally combined motion information candidate list generation unit 1002, the first additional combination is performed. MaxNumGenCand, which is the maximum number for generating motion information candidates, is calculated from Equation 3 (S2000).
MaxNumGenCand = MaxNumMergeCand-NumCandList; (NumCandList> 1)
MaxNumGenCand = 0; (NumCandList <= 1) (Formula 3)

  Next, it is inspected whether MaxNumGenCand is larger than 0 (S2001). If MaxNumGenCand is not greater than 0 (NO in S2001), the process ends. If MaxNumGenCand is greater than 0 (YES in S2001), the following processing is performed. First, loopTimes that is the number of combination inspections is determined. loopTimes is set to NumCandList × NumCandList. However, if loopTimes exceeds 8, loopTimes is limited to 8 (S2002). Here, loopTimes is an integer from 0 to 7. The following processing is repeatedly performed for loopTimes (S2002 to S2009).

  A combination of the combined motion information candidate M and the combined motion information candidate N is determined (S2003). Here, the relationship between the number of combination inspections, the combined motion information candidate M, and the combined motion information candidate N will be described.

  FIG. 22 is a diagram for explaining the relationship among the number of combination inspections, the combined motion information candidate M, and the combined motion information candidate N. As shown in FIG. 22, M and N are different values, and are set in order of decreasing total value of M and N.

  It is checked whether the L0 prediction of the combined motion information candidate M is valid and the L1 prediction of the combined motion information candidate N is valid (S2004). If the L0 prediction of the combined motion information candidate M is valid and the L1 prediction of the combined motion information candidate N is valid (YES in S2004), the reference image and the motion vector of the combined motion information candidate M for the L0 prediction are combined motion information candidates. It is checked whether the reference image and the motion vector of N L1 prediction are different (S2005). If the L0 prediction of the combined motion information candidate M is not valid and the L1 prediction of the combined motion information candidate N is not valid (NO in S2004), the next combination is processed. If the L0 prediction reference image of the combined motion information candidate M and the L1 prediction reference image of the combined motion information candidate N are different (YES in S2005), the combined motion information of the L0 prediction motion vector of the combined motion information candidate M and the reference image is combined. A combined motion information candidate is generated by combining the motion vector of L1 prediction of candidate N and the reference image (S2006). Here, as the first additional combined motion information candidate, bi-coupled motion information is generated by combining L0 prediction of a certain combined motion information candidate and L1 prediction motion information of a different combined motion information candidate. If the reference image for L0 prediction of the combined motion information candidate M and the reference image for L1 prediction of the combined motion information candidate N are the same (NO in S2005), the next combination is processed. Subsequent to step S2006, bi-join motion information candidates are added to the joint motion information candidate list (S2007). Subsequent to step S2007, it is checked whether the number of generated double-coupled motion information is MaxNumGenCand (S2008). If the number of generated double coupled motion information is MaxNumGenCand (YES in S2008), the process ends. If the number of generated double coupled motion information is not MaxNumGenCand (NO in S2008), the next combination is processed.

  Here, the first additional combined motion information candidate is set as the L0 prediction motion vector of a certain combined motion information candidate registered in the combined motion information candidate list and the reference image, and the L1 prediction motion vector of another combined motion information candidate. In combination with the reference image, a bi-coupled motion information candidate whose prediction type of motion compensation prediction is bi-prediction is used, but the present invention is not limited to this. For example, a combined motion whose prediction type of motion compensated prediction in which an offset value such as +1 is added to a motion vector of L0 prediction and a motion vector of L1 prediction of a certain combined motion information candidate registered in the combined motion information candidate list is bi-prediction A combination in which the prediction type of motion compensated prediction in which an offset value such as +1 is added to the motion vector of the L0 prediction or the motion vector of the L1 prediction of a certain combined motion information candidate registered in the information candidate or the combined motion information candidate list is single prediction It is good also as a motion information candidate, and may combine them arbitrarily.

  Here, the first additional combined motion information candidate is a combined motion information candidate when there is a slight difference between the motion information of the combined motion information candidate registered in the combined motion information candidate list and the motion information candidate motion to be processed. Coding efficiency can be improved by correcting the motion information of the combined motion information candidates registered in the list to generate effective combined motion information candidates.

Next, the detailed operation of the second combined motion information candidate list adding unit 1004 will be described. FIG. 23 is a flowchart for explaining the operation of the second combined motion information candidate list adding unit 1004. First, the first addition from the number of combined motion information candidates (NumCandList) and the maximum number of combined motion information candidates (MaxNumMergeCand) registered in the combined motion information candidate list supplied from the first combined motion information candidate list adding unit 1003. MaxNumGenCand, which is the maximum number for generating combined motion information candidates, is calculated from Equation 4 (S2200).
MaxNumGenCand = MaxNumMergeCand-NumCandList; (Formula 4)

  Next, the following process is repeated MaxNumCand times for i (S2201 to S2205). Here, i is an integer from 0 to MaxNumGenCand-1. The second additional combined motion in which the motion vector for L0 prediction is (0,0), the reference index is i, the motion vector for L1 prediction is (0,0), and the prediction type is i for the reference index is bi-prediction. Information candidates are generated (S2202). The second additional combined motion information candidate is added to the combined motion information candidate list (S2203). The next i is processed (S2204).

  Here, the second additional combined motion information candidate has a motion vector for L0 prediction of (0, 0), a reference index of i, a motion vector of L1 prediction of (0, 0), and a reference index of i. The combined motion information candidate whose prediction type is bi-prediction was used. This is because, in a general moving image, the frequency of occurrence of combined motion information candidates in which the motion vector for L0 prediction and the motion vector for L1 prediction are (0, 0) is statistically high. The present invention is not limited to this as long as it is a combined motion information candidate that is statistically frequently used without depending on the motion information of the combined motion information candidate registered in the combined motion information candidate list. For example, the motion vectors of L0 prediction and L1 prediction may be vector values other than (0, 0), respectively, and may be set so that the reference indexes of L0 prediction and L1 prediction are different. Alternatively, the second additional combined motion information candidate can be set as an encoded image or motion information with a high occurrence frequency of a part of the encoded image, encoded in an encoded stream, and transmitted. Although the B picture (B slice) has been described here, in the case of the P picture (P slice), the second additional combined motion in which the motion vector for L0 prediction is (0, 0) and the prediction type is L0 prediction. Generate information candidates.

  Here, by setting a combined motion information candidate that does not depend on the combined motion information candidate registered in the combined motion information candidate list as the second additional combined motion information candidate, the combined motion information candidate registered in the combined motion information candidate list When the number is zero, it is possible to use the joint prediction mode and improve the encoding efficiency. In addition, when the motion information of the combined motion information candidate registered in the combined motion information candidate list and the motion information candidate motion to be processed are different, by generating a new combined motion information candidate and expanding the range of options, Encoding efficiency can be improved.

  FIG. 24 is a flowchart for explaining the detailed operation of the combined prediction mode evaluation value generation process in step S1101 of FIG. This operation shows the detailed operation of the configuration using the combined motion compensation prediction generation unit 908 of FIG.

  First, the prediction error evaluation value is set to the maximum value, and the combined motion information index that minimizes the prediction error is initialized (for example, a value outside the list such as −1) (S2300). If the number of combined motion information candidate lists generated by the combined motion information candidate list generation process is num_of_index, the following processing is repeated for combined motion information candidates from i = 0 to num_of_index-1 (S2301 to S2309).

  First, the motion information stored in the index i is acquired from the combined motion information candidate list (S2302). Subsequently, a motion information code amount is calculated (S2303). In the joint prediction mode, since only the joint motion information index is encoded, only the joint motion information index becomes the motion information code amount.

  In the first embodiment, a Truncated Unary code string is used as the code string of the combined motion information index. FIG. 25 is a diagram illustrating a Truncated Unary code string when the number of combined motion information candidates is five. When the value of the combined motion information index is encoded using the Truncated Unary code string, the smaller the combined motion information index, the smaller the code bit assigned to the combined motion information index. For example, when the number of combined motion information candidates is 5, if the combined motion information index is 1, it is represented by 2 bits of “10”, but if the combined motion information index is 3, 4 bits of “1110”. It is expressed by Here, as described above, the Truncated Unary code string is used for encoding the combined motion information index, but other code string generation methods can be used, and the present invention is not limited to this.

  Subsequently, when the prediction type of the motion information is single prediction (S2304: YES), the reference image designation information and the motion vector for one reference image are set in the motion compensation prediction unit 108 in FIG. A prediction block is generated (S2305). When the motion information is not uni-prediction (S2304: NO), reference image designation information and motion vectors for two reference images are set in the motion compensated prediction unit 108 to generate a motion compensated bi-prediction block (S2306).

  Subsequently, a prediction error evaluation value is calculated from the prediction error and the motion information code amount of the motion compensated prediction block and the prediction target block (S2307). If the prediction error evaluation value is the minimum value, the evaluation value is updated. The prediction error minimum index is updated (S2308).

  As a result of comparison of the prediction error evaluation values for all the combined motion information candidates, the selected prediction error minimum index is output together with the prediction error minimum value and the motion compensated prediction block as a combined motion information index used in the combined prediction mode. (S2310) The combined prediction mode evaluation value generation process ends.

  FIG. 26 is a flowchart for explaining detailed operation of the prediction mode evaluation value generation processing in step S1102 of FIG.

  First, it is determined whether or not the prediction mode is single prediction (S2500). If it is single prediction, the reference image list (LX) to be processed is set as the reference image list used for prediction (S2501). If it is not uni-prediction, it is bi-prediction, so LX is set to L0 in this case (S2502).

  Next, reference image designation information (index) and motion vector values for LX prediction are acquired (S2503). Subsequently, a prediction vector candidate list is generated (S2504), an optimal prediction vector is selected from the prediction vectors, and a difference vector is generated (S2505). It is desirable to select the optimal prediction vector with the least amount of code when the difference vector between the prediction vector and the motion vector to be transmitted is actually encoded. However, the horizontal and vertical components of the difference vector are simply selected. The calculation may be simplified by a method such as selecting one having a small absolute sum.

  Subsequently, it is determined again whether or not the prediction mode is single prediction (S2506). If the prediction mode is single prediction, the process proceeds to step S2509. If it is not uni-prediction, that is, if it is bi-prediction, it is determined whether the reference list LX to be processed is L1 (S2507). If the reference list LX is L1, the process proceeds to step S2509. If it is not L1, that is, if it is L0, LX is set to L1 (S2508), and the same processing as the processing from step S2503 to step S2506 is performed.

  Subsequently, a motion information code amount is calculated (S2509). In the case of the uni-prediction mode, the motion information to be encoded includes three elements of reference image designation information, a difference vector value, and a prediction vector index for one reference image. In the case of the bi-prediction mode, L0 and L1 The reference image designation information, the difference vector value, and the prediction vector index for the two reference images are a total of six elements, and the total amount of the encoded amount is calculated as the motion information code amount. As a prediction vector index code string generation method according to the present embodiment, a Trunked Unary code string is used in the same manner as the combined motion information index code string.

  Subsequently, the reference image designation information and the motion vector for the reference image are set in the motion compensated prediction unit 108 in FIG. 1 to generate a motion compensated prediction block (S2510).

  Further, a prediction error evaluation value is calculated from the prediction error and the motion information code amount of the motion compensated prediction block and the prediction target block (S2511), the prediction error evaluation value, and reference image designation information that is motion information for the reference image; The difference vector value and the prediction vector index are output together with the motion compensated prediction block (S2512), and the prediction mode evaluation value generation process ends.

  The above processing is the detailed operation of the prediction mode determination unit 109 in the video encoding apparatus in the first embodiment.

[Detailed Operation Description of Motion Information Decoding Unit in Moving Picture Decoding Device in Embodiment 1]
FIG. 27 is a diagram showing a detailed configuration of the motion information decoding unit 606 in the video decoding device according to Embodiment 1 shown in FIG. The motion information decoding unit 606 includes a motion information bitstream decoding unit 2600, a prediction vector calculation unit 2601, a vector addition unit 2602, a motion compensation prediction decoding unit 2603, a combined motion information calculation unit 2604, and a combined motion compensation prediction decoding unit 2605. .

  For the motion information decoding unit 606 in FIG. 6, the motion information bitstream input from the demultiplexing unit 601 is supplied to the motion information bitstream decoding unit 2600, and the motion information input from the motion information memory 607 is predicted. This is supplied to the vector calculation unit 2601 and the combined motion information calculation unit 2604.

  In addition, the motion compensation prediction prediction unit 608 outputs reference image designation information and motion vectors used for motion compensation prediction from the motion compensation prediction decoding unit 2603 and the combined motion compensation prediction decoding unit 2605, and indicates information indicating the prediction type. The included decoded motion information is stored in the motion information memory 607.

  The motion information bitstream decoding unit 2600 generates the motion information corresponding to the transmitted prediction mode and the prediction mode by decoding the motion information bitstream input from the demultiplexing unit 601 according to the encoding syntax. To do. Among the generated motion information, the combined motion information index is supplied to the combined motion compensation prediction decoding unit 2605, the reference image designation information is supplied to the prediction vector calculation unit 2601, and the prediction vector index is supplied to the vector addition unit 2602. The difference vector value is supplied to the vector addition unit 2602.

  The prediction vector calculation unit 2601 predicts a reference image to be subjected to motion compensation prediction from the motion information of the adjacent block supplied from the motion information memory 607 and the reference image designation information supplied from the motion information bitstream decoding unit 2600. A vector candidate list is generated and supplied to the vector addition unit 2602 together with the reference image designation information. Regarding the operation of the prediction vector calculation unit 2601, the same operation as that of the prediction vector calculation unit 902 of FIG. 9 in the moving image encoding apparatus is performed, and the same candidate list as the prediction vector candidate list at the time of encoding is generated.

  The vector addition unit 2602 indicates a prediction vector index from the prediction vector candidate list and reference image designation information supplied from the prediction vector calculation unit 2601 and the prediction vector index and difference vector supplied from the motion information bitstream decoding unit 2600. By adding the prediction vector value and the difference vector value registered at the set position, the motion vector value for the reference image to be motion compensated prediction is reproduced. The reproduced motion vector value is supplied to the motion compensated prediction decoding unit 2603 together with the reference image designation information.

  The motion compensated prediction decoding unit 2603 is supplied with the reproduced motion vector value and reference image designation information for the reference image from the vector addition unit 2602, and sets the motion vector value and the reference image designation information in the motion compensated prediction unit 608. Thus, a motion compensated prediction signal is generated.

  The combined motion information calculation unit 2604 generates a combined motion information candidate list from the motion information of adjacent blocks supplied from the motion information memory 607, and combines the combined motion information candidate list and the combined motion information candidate that is a component in the list. The reference image designation information and the motion vector value are supplied to the combined motion compensation prediction decoding unit 2605.

  Regarding the operation of the combined motion information calculation unit 2604, the same operation as that of the combined motion information calculation unit 906 in FIG. 9 in the moving image encoding apparatus is performed, and the same candidate list as the combined motion information candidate list at the time of encoding is generated. Is done.

  The combined motion compensated prediction decoding unit 2605 supplies a combined motion information candidate list supplied from the combined motion information calculation unit 2604, reference image designation information of a combined motion information candidate that is a component in the list, a motion vector value, and a motion information bit. The reference image designation information and the motion vector value in the combined motion information candidate list indicated by the combined motion information index are reproduced from the combined motion information index supplied from the stream decoding unit 2600 and set in the motion compensation prediction unit 608. Generate a motion compensated prediction signal.

  FIG. 28 is a flowchart for explaining the detailed operation of the motion information decoding process in step S701 of FIG. The motion information decoding process in step S701 in FIG. 7 is performed by the motion information bitstream decoding unit 2600, the prediction vector calculation unit 2601, and the combined motion information calculation unit 2604.

  The motion information decoding process is a process of decoding motion information from an encoded bit stream encoded with a specific syntax structure. First, the Skip flag is decoded in a predetermined unit of the encoded block (S2700). Thereafter, processing is performed in units of prediction blocks.

  When the Skip flag indicates the Skip mode (S2701: YES), joint prediction motion information decoding is performed (S2702). Detailed processing in step S2702 will be described later.

  If it is not the Skip mode (S2701: NO), the merge flag is decoded (S2703). If the merge flag indicates 1 (S2704: YES), the process proceeds to joint prediction motion information decoding in step S2702.

  When the merge flag is not 1 (S2704: NO), the motion prediction flag is decoded (S2705), and the prediction motion information is decoded (S2706). Detailed operation of step S2706 will be described later.

  FIG. 29 is a flowchart for explaining detailed operation of the joint prediction motion information decoding process in step S2702 of FIG.

  First, the combined prediction mode is set as the prediction mode (S2800), and a combined motion information candidate list is generated (S2801). The processing in step S2801 is the same processing as the combined motion information candidate list generation processing in step S1100 of FIG. 11 in the video encoding device.

  Next, the combined motion information index is decoded (S2802), and then the motion information stored at the position indicated by the combined motion information index is acquired from the combined motion information candidate list (S2803). The motion information to be acquired includes a prediction type indicating single prediction / bi-prediction, reference image designation information, and a motion vector value.

  The generated motion information is stored as motion information in the joint prediction mode (S2804), and is supplied to the joint motion compensation prediction decoding unit 2606.

  FIG. 30 is a flowchart for explaining the detailed operation of the prediction motion information decoding process in step S2706 of FIG.

  First, it is determined whether or not the prediction type is single prediction (S2900). If it is simple prediction, the reference image list (LX) to be processed is set as the reference image list used for prediction (S2901). If it is not uni-prediction, it is bi-prediction. In this case, LX is set to L0 (S2902).

  Next, the reference image designation information is decoded (S2903), and the difference vector value is decoded (S2904). Next, a prediction vector candidate list is generated (S2905). When the prediction vector candidate list is larger than 1 (S2906: YES), the prediction vector index is decoded (S2907), and when the prediction vector candidate list is 1 (S2906: NO), 0 is set to the prediction vector index (S2908).

  Here, in step S2905, processing similar to that in step S2504 in the flowchart of FIG. 26 in the video encoding device is performed.

  Next, the motion vector value stored at the position indicated by the prediction vector index is acquired from the prediction vector candidate list (S2909). A motion vector is reproduced by adding the decoded difference vector value and motion vector value (S2910).

  Subsequently, it is determined again whether or not the prediction type is single prediction (S2911). If the prediction type is single prediction, the process proceeds to step S2914. If it is not uni-prediction, that is, if it is bi-prediction, it is determined whether the reference list LX to be processed is L1 (S2912). If the reference list LX is L1, the process proceeds to step S2914, and if it is not L1, that is, if it is L0, LX is set to L1 (S2913), and the same processing as the processing from step S2903 to step S2911 is performed.

  Subsequently, as the generated motion information, in the case of single prediction, reference image designation information and motion vector values for one reference image, and in the case of bi-prediction, reference image designation information and motion for two reference images. The vector value is stored as motion information (S2914) and supplied to the motion compensated prediction decoding unit 2603.

In the moving image encoding device and the moving image decoding device according to the first embodiment, in the combined motion information calculation unit, the temporally combined motion information candidate list generation unit is arranged after the combined motion information candidate list deletion unit, and the space By using only combined motion information candidates as targets for combined motion information candidate deletion processing, it becomes possible to appropriately delete combined motion information candidates having the same motion information from the combined motion information candidate list with a small amount of computation. As a result, by adding new combined motion information candidates to the combined motion information candidate list, the types of motion information that can be used in the combined prediction mode are increased, and the coding efficiency can be improved.

  Further, in the moving image encoding device and the moving image decoding device according to the first embodiment, the number of times of comparison of motion information is reduced in the motion information candidate list deletion unit, so that the effect of reducing the circuit scale and processing time is also obtained. Have.

(Embodiment 2)
Next, a second embodiment of the present invention will be described. The second embodiment differs from the first embodiment in the operation of deleting combined prediction candidates. Since the configuration and processing other than the combined prediction candidate deletion operation are the same as those in the first embodiment, here, the difference from the first embodiment of the combined motion information list deletion process in the combined motion information candidate list deletion unit 1001 in FIG. Only explained.

  FIG. 31 is a flowchart for explaining a detailed operation of combined motion information candidate deletion in the second embodiment. Assuming that the maximum number of combined motion information candidates generated by the spatially combined motion information candidate list creation process (S1200) in the spatially combined motion information candidate list generation unit 1000 is maxSpatialCand, i = maxSpatialCand-1 to i> 0 The following processing is repeated for the motion information candidate (candidate (i)) (S3000 to S3004).

  The candidate (i) exists (YES in S3001), and the motion information (motion information (i)) of the candidate (i) and the motion information (motion information (i-1)) of the candidate (i-1) are the same. (YES in S3002), the candidate (i) is deleted from the combined motion information candidate list (S3003).

  If the candidate (i) does not exist (NO in S3001), or even if it exists, the motion information (i) and the motion information (i-1) are not the same (NO in S3002), the process is repeated (S3004).

  Subsequently, there is a candidate (maxSpatialCand-1) (YES in S3005), the motion information (motion information (maxSpatialCand-1)) of the candidate (maxSpatialCand-1) and the first combined motion information in the combined motion information candidate list If the candidate (motion information (0)) is the same (YES in S3006), the candidate (max SpatialCand-1) is deleted (S3007), and the process ends.

  If there is no candidate (max Spatial Cand-1) (NO in S3005), or if it exists but the motion information (max Spatial Cand-1) and the motion information (0) are not the same (NO in S3006), the process ends. .

  FIG. 32 is an example of comparison contents of candidates in combined motion information candidate deletion in Embodiment 2 when the maximum number of spatially combined motion information candidates is 4. As shown in FIG. 32, when the maximum number of spatially coupled motion information candidates is 4, only four comparisons are performed.

  FIG. 33 shows a comparison relationship of candidates in the list when there are four combined motion information candidates. That is, for four spatially combined motion information candidates that do not include temporally combined motion information candidates, the candidates that are adjacent in the sequence order of the combined motion information candidate list are compared, and the highest candidate and the lowest candidate are compared. As a result, identity is determined, and duplicate candidates are deleted.

  FIG. 34 is a diagram for explaining comparison of neighboring blocks in the combined motion information candidate deletion process when the maximum number of spatially combined motion information candidates is four. FIG. 34A shows an example in which the blocks A1, B1, B0, A0 can be used. When the blocks A1, B1, B0, and A0 are usable, the combined motion information candidate list created by the above-described spatially coupled motion information candidate list creation process is {A1, B1, B0, A0}. The comparison of the motion information in the combined motion information candidate deletion is performed in the relationship of the arrows in FIG.

  Similarly, FIG. 34 (b) shows that the blocks B1, B0, A0, and B2 can be used, and FIG. 34 (c) shows that the combined motion information candidates are deleted when the blocks A1, B1, B0, and B2 are available. This shows the relationship of motion information comparison.

  Here, since the motion information is strongly continuous in the spatial direction, the probability that the motion information is the same in adjacent blocks is high, while the probability that the motion information is the same in a non-adjacent block is low. Therefore, in the combined motion information candidate deletion process, it is possible to appropriately delete the same motion information even if only comparison between adjacent blocks is performed.

  In addition, in order to compare only the motion information of adjacent blocks, a method of comparing motion information at predetermined block positions in the peripheral candidate block group is also conceivable, but in this case, each motion in the combined motion information candidate list is considered. It is necessary to record all the block positions of information candidates, which leads to an increase in circuit scale and complexity of processing.

  Therefore, in the combined motion information candidate deletion in Embodiment 2 of the present invention, the combined motion information candidate list is compared in the order added to the combined motion information candidate list regardless of the block position of the combined motion information candidate. By comparing the last candidate with the first candidate, it is possible to compare motion information between adjacent blocks as shown in FIG. 34, and it is possible to appropriately delete the same motion information with a small number of comparisons. Is possible.

(Embodiment 3)
Next, a third embodiment of the present invention will be described. The third embodiment differs from the first embodiment in the operation of deleting combined prediction candidates. Since the configuration and processing other than the combined prediction candidate deletion operation are the same as those in the first embodiment, here, the difference from the first embodiment of the combined motion information list deletion process in the combined motion information candidate list deletion unit 1001 in FIG. Only explained.

  FIG. 35 is a flowchart for explaining the detailed operation of combined motion information candidate deletion in the third embodiment. The number of combined motion information candidates generated by the spatially combined motion information candidate list creation processing (S1200) in the spatially combined motion information candidate list generation unit 1000 is numCand, and the combined motion information candidate comparison operation in the combined motion information candidate deletion operation is performed. When the number of times is numCompare, the following processing is repeated from i = numCompare [numCand] -1 to i> = 0 (S3300 to S3303).

  Here, the number of comparison operations numCompare [i] is determined as shown in FIG. 37A according to the value of numCand. Further, the values of the comparison candidate index cur [i] and the reference candidate index ref [i] are determined according to the value of i as shown in FIG.

  Motion information (motion information (cur [i])) and motion information (ref [i]) of the motion information candidate (cur [i]) and motion information (ref [i]) of the index motion [i] of the combined motion information candidate list ( If the motion information (ref [i]) is the same (YES in S3301), the candidate (cur [i]) is deleted from the combined motion information candidate list (S3302).

  If the motion information (cur [i]) and the motion information (ref [i]) are not the same (NO in S3301), the process is repeated (S3303).

  FIG. 36 shows a comparison relationship of candidates in the list when there are four combined motion information candidates. That is, for the four spatially combined motion information candidates that do not include the temporally combined motion information candidates, the candidates included from the top to the third in the order of arrangement in the combined motion information candidate list are compared brute force, and if necessary By comparing the highest candidate with the lowest candidate, the identity is determined, and duplicate candidates are deleted.

  As shown in FIG. 37, in the combined prediction candidate deletion operation according to Embodiment 3 of the present invention, the number of motion information comparisons is the combination of combined motion information candidate lists generated by the spatially combined motion information candidate list generation unit. Depending on the number of motion information candidates, the number of times is 0 to 4, and the number of comparisons can be greatly reduced as compared to the case where all motion information is compared.

  In addition, since all combinations are compared for the first three combined motion candidates in the combined motion information candidate list, the combined motion information candidates having the same motion information cannot be deleted due to the reduction of the number of comparisons. The same motion information exists only in the second half of the combined motion information candidate list.

  As described above, a Truncated Unary code sequence is used as the code sequence of the combined motion information index. Therefore, if redundant motion information exists in a short small index value of the code sequence, it leads to a decrease in coding efficiency. According to the combined motion information candidate deletion method in aspect 3, since the same motion information in the combined motion information candidate list having a small index value can be reliably deleted, the motion information can be encoded while reducing the processing load. Efficiency can be improved.

(Embodiment 4)
Next, a fourth embodiment of the present invention will be described. The fourth embodiment differs from the second embodiment in the operation of deleting combined prediction candidates. Since the configuration and processing other than the combined prediction candidate deletion operation are the same as those in the second embodiment, here, the difference from the first embodiment of the combined motion information list deletion process in the combined motion information candidate list deletion unit 1001 in FIG. Only explained.

  FIG. 38 is a flowchart for explaining detailed operation of combined motion information candidate deletion in the fourth embodiment. First, when the number of combined motion information candidates generated by the spatially combined motion information candidate list creation process (S1200) in the spatially combined motion information candidate list generation unit 1000 is numCand, and the maximum number of combined motion information candidates is maxSpatialCand, If numCand> 0 (YES in S3500), the value of the combined motion information candidate (candidate (i)) from i = max SpatialCand-1 to i> = numCand is used as the last combined motion information candidate ( Candidate (numCand-1)) (S3501 to S3503).

  If numCand is 0 or less (NO in S3500), the process is terminated without doing anything.

  Next, the following processing is repeated for the combined motion information candidates (candidate (i)) from i = maxSpatialCand-1 to i> 0 (S3504 to S3507).

  When the motion information (motion information (i)) of the candidate (i) and the motion information (motion information (i-1)) of the candidate (i-1) are the same (YES in S3505), the candidate (i) is combined. Delete from the motion information candidate list (S3506).

  If the motion information (i) and the motion information (i-1) are not the same (NO in S3505), the process is repeated (S3507).

  Subsequently, there is a candidate (maxSpatialCand-1) (YES in S3508), the motion information (motion information (maxSpatialCand-1)) of the candidate (maxSpatialCand-1) and the first combined motion information in the combined motion information candidate list If the candidate (motion information (0)) is the same (YES in S3509), the candidate (max SpatialCand-1) is deleted (S3510), and the process ends.

  If the candidate (max Spatial Cand-1) does not exist (NO in S3508), or if it exists but the motion information (max SpatialCand-1) and the motion information (0) are not the same (NO in S3509), the process ends. .

  The operation of deleting combined motion information candidates in the fourth embodiment of the present invention differs from the operation of deleting combined motion information candidates in the second embodiment in that S3500 to S3503 are added and S30001 is deleted. By adding S3500 to S3503, the number of combined motion information candidates generated by the spatially combined motion information candidate list creation process (S1200) in the spatially combined motion information candidate list generation unit 1000 is the maximum number of spatially combined motion information candidates. In the case where the combined motion information candidate is not satisfied, the combined motion information candidates at the end of the combined motion information candidates are added up to the maximum number of combined motion information candidates.

  FIG. 39 shows a comparison relationship of candidates in the list when there are four combined motion information candidates. That is, when the number of candidates registered in the combined motion information candidate list is less than the predetermined maximum number of candidates, the lowest candidate in the combined motion information candidate list is copied to fill in the empty candidates, and then the combined motion information candidate By comparing adjacent candidates in the arrangement order of the list, and comparing the highest candidate with the lowest candidate, the identity is determined, and duplicate candidates are deleted. For example, when one candidate is missing, the third candidate is copied fourth, the adjacent candidates are compared, and the top candidate and the bottom candidate are compared, resulting in three This is essentially the same as a brute force comparison of candidates.

  FIG. 40 is a diagram for explaining the operation of deleting combined motion information candidates in the fourth embodiment of the present invention. FIG. 40A shows the combined motion information candidates after addition before adding the leading candidate when the number of generated combined motion information candidates is 3 and the maximum number of spatially combined motion information candidates is 4. Thus, since the last combined motion information candidate in the list is added to the position of index 3, the combined motion information candidates in S3504 to S3507 are compared as shown in FIG. When the number of candidates is less than the maximum number of spatially combined motion information candidates, comparison is performed for all combinations, and it is possible to reliably delete combined motion information candidates of the same motion information.

(Embodiment 5)
Next, a fifth embodiment of the present invention will be described. Embodiment 5 differs from Embodiment 1 in the operation of deleting combined prediction candidates. Since the configuration and processing other than the combined prediction candidate deletion operation are the same as those in the first embodiment, here, the difference from the first embodiment of the combined motion information list deletion process in the combined motion information candidate list deletion unit 1001 in FIG. Only explained.

  FIG. 41 is a flowchart for explaining detailed operation of combined motion information candidate deletion in the third embodiment. Assuming that the maximum number of combined motion information candidates generated by the spatially combined motion information candidate list creation process (S1200) in the spatially combined motion information candidate list generation unit 1000 is maxSpatialCand, i = max SpatialCand-1 to i> = 0 or less. This process is repeated (S3700 to S3704).

  Here, the values of the comparison candidate index cur [i] and the reference candidate index ref [i] are determined according to the value of i as shown in FIG.

  There is a combined motion information candidate (candidate (cur [i])) of index cur [i] in the combined motion information candidate list (YES in S3701), and motion information (motion information (motion information ( cur [i])) and the candidate (ref [i]) have the same motion information (motion information (ref [i])) (YES in S3702), the candidate (cur [i]) is the combined motion information candidate. Delete from the list (S3703).

  When there is no candidate (cur [i]) (NO in S3701), or even if it exists, the motion information (cur [i]) and the motion information (ref [i]) are not the same (NO in S3702). The process is repeated (S3004).

  FIG. 42 shows a comparison relationship of candidates in the list when there are four combined motion information candidates. That is, for the four spatially combined motion information candidates that do not include the temporally combined motion information candidate, adjacent candidates are compared for the top to third in the order of arrangement in the combined motion information candidate list, and the lowest candidate and the lowest candidate are compared. By comparing the upper candidates and further comparing the lowest candidate with the second candidate, the identity is determined, and duplicate candidates are deleted.

  As shown in FIG. 43, in the combined prediction candidate deletion operation according to Embodiment 5 of the present invention, the number of comparisons of motion information is 4, and the number of comparisons is smaller than when all motion information is compared. It can be greatly reduced.

  FIG. 44 shows neighboring blocks in the combined prediction candidate deletion process according to Embodiment 5 of the present invention when the maximum number of spatially combined motion information candidates is 4 and block A0 is unusable among spatially combined motion information candidate blocks. It is a figure explaining the comparison of. As shown in FIG. 44, according to the operation of spatially coupled motion information candidate deletion in the fifth embodiment of the present invention, when block A0 is unusable, an appropriate comparison is performed between adjacent blocks. Yes.

  FIG. 45 is a diagram showing a usable state of the block A0 in various prediction block sizes and the intra-CU division mode. In FIG. 45, a prediction block that can be used by the block A0 is indicated by ◯, and a prediction block that cannot be used is indicated by ×. As shown in FIG. 45, since the frequency at which the block A0 becomes unusable is high, the same motion information is appropriately deleted at a high frequency by performing an appropriate comparison when the block A0 becomes unusable. Therefore, it is possible to improve the encoding efficiency of motion information while reducing the processing load.

(Embodiment 6)
Next, a sixth embodiment of the present invention will be described. The sixth embodiment is different from the third embodiment in the number of comparison operations numCompare in the configuration of the combined motion information calculation unit 906, the detailed operation of combined motion information candidate list generation in step S1100 in FIG. The values of [i], the comparison candidate index cur [i], and the reference candidate index ref [i] are different. Since other configurations and processing are the same as those in the third embodiment, here, the configuration of the combined motion information calculation unit 906, the detailed operation of combined motion information candidate list generation in step S1100 of FIG. 11, and the comparison in combined prediction candidate deletion Only differences from the third embodiment in the values of the number of operations numCompare [i], the comparison candidate index cur [i], and the reference candidate index ref [i] will be described.

  FIG. 46 is a diagram showing a configuration of the combined motion information calculation unit 906 according to Embodiment 6 of the present invention. The combined motion information calculation unit 906 includes a spatial combined motion information candidate list generation unit 4000, a temporal combined motion information candidate list generation unit 4002, a combined motion information candidate list deletion unit 4001, a first combined motion information candidate list addition unit 4003, and a second. A combined motion information candidate list adding unit 4004 is included. The combined motion information calculation unit 906 creates motion information candidates in a predetermined order from spatially adjacent candidate block groups, deletes candidates having the same motion information from the candidates, and then temporally adjacent. By adding motion information candidates created from the candidate block group, only valid motion information is registered as combined motion information candidates.

  FIG. 47 is a flowchart for explaining the detailed operation of generating the combined motion information candidate list in step S1100 of FIG. 11 in the sixth embodiment of the present invention. This operation shows the detailed operation in the sixth embodiment of the present invention having the configuration in the combined motion information calculation unit 906 in FIG.

  Operations of the spatially combined motion information candidate list generation (S4200), the temporally combined motion information candidate list generation (S4202), the first combined motion information candidate list addition (S4203), and the second combined motion information candidate list addition (S4204) of FIG. Since this is the same as the step assigned with the same number in FIG. 12 in the third embodiment of the present invention, its description is omitted.

  The combined motion information candidate list deletion unit 4001 deletes the combined motion information candidates having the same motion information from the combined motion information candidate list generated by the time combined motion information candidate list generation unit 4002 to generate a motion information candidate list. Update (S4201). This combined motion information candidate list deletion unit 4001 is arranged after the temporal combined motion information candidate list generation unit 4002 and includes the combined temporal motion information candidate in the combined prediction candidate deletion process in the combined prediction candidate deletion operation described later. It is the characteristic in the actual form 6 of this invention.

  Next, the detailed operation of combined prediction candidate deletion in Embodiment 6 of the present invention will be described using FIG. 35 and FIG. FIG. 35 is a flowchart for explaining the detailed operation of joint prediction candidate deletion in the sixth embodiment of the present invention, which is the same as the detailed operation of joint prediction candidate deletion in the third embodiment of the present invention.

  Also, the number of combined prediction candidates included in the combined motion information candidate list generated by the temporal combined motion information candidate list generation unit 4002 is numCand, and the number of comparison operations numCompare [i] is set according to the value of numCand (FIG. 48 (). As in a), the values of the comparison candidate index cur [i] and the reference candidate index ref [i] are determined as shown in FIG. 48B according to the value of i.

  In Embodiment 6 of the present invention, the maximum number of spatially coupled prediction candidates generated by spatially coupled motion information candidate list generating section 4000 is 4, and temporal coupled motion information candidate list generating section 4002 is temporally coupled. Since motion information candidates are generated, the maximum number of combined prediction candidates included in the combined prediction candidate list is 5, but the number of comparison operations numCompare [i] is the value of numCand as shown in FIG. Is 4 when is 5.

  That is, when the number of spatial motion information candidates generated by the spatial combination motion information candidate list generation unit 4000 is 4, which is the maximum value, the temporal combination generated by the time combination motion information candidate list generation unit 4002 Since the motion information candidate is not a target of the comparison operation in the combined prediction candidate deletion operation, the operation of performing the combined motion information candidate deletion (S4201) in the preceding stage of the time combined motion information candidate list generation (S4202), that is, the implementation of the present invention The operation is the same as that of the combined motion information candidate list generation in the third mode.

  On the other hand, when the number of spatial motion information candidates generated by the spatial combination motion information candidate list generation unit 4000 is less than 4, which is the maximum value, the time generated by the time combination motion information candidate list generation unit 4002 The combined motion information candidate is also subjected to a comparison operation in the combined prediction candidate deletion operation.

  FIG. 49 shows a comparison relationship between candidates in the list when there are four spatially coupled motion information candidates and when there are three spatially coupled motion information candidates. That is, when there are four spatially coupled motion information candidates (FIG. 49 (a)), the fourth spatially coupled motion information candidate not including the temporally coupled motion information candidate is the third highest from the top in the sequence order of the coupled motion information candidate list. The candidates included in the above are compared by brute force, and if necessary, the highest candidate and the lowest candidate are compared to determine the identity, and duplicate candidates are deleted. When there are three spatially combined motion information candidates (FIG. 49 (b)), four combined motion information candidates including temporally combined motion information candidates are included from the top to the third in the sequence of the combined motion information candidate list. The candidates are compared with each other, and if necessary, the highest candidate and the lowest candidate are compared to determine the identity, and duplicate candidates are deleted.

  Therefore, when the number of effective spatial motion information candidates is the maximum value, the temporally combined motion information candidates having different characteristics are excluded from the target of the combined motion information candidate deletion process, and the processing load is reduced. If the number of the motion information candidates is less than the maximum value, the combined motion information candidate deletion processing accuracy can be further increased with the same processing load by using the temporally combined motion information candidates as the target of the combined motion information candidate deletion processing. Therefore, it is possible to improve the encoding efficiency of motion information while reducing the processing load.

  In the above description, an example in which the method of Embodiment 3 is used as the combined prediction candidate comparison method has been described in Embodiment 6, but in Embodiment 6, the combined prediction candidate comparison method is implemented. Any of the methods of forms 1, 2, 4, and 5 may be applied.

  The moving picture encoding apparatus and moving picture decoding apparatus according to the embodiments described above have the following technical features.

  [1] In the candidate deletion process in the merge coding technique, the candidate deletion process is performed prior to the generation of the temporal combination motion information candidate, and the temporal combination prediction candidates are excluded from the candidates for the candidate deletion process (FIGS. 10 and 12). Steps S1201 and S1202). As a result, the number of candidate comparison operations in the candidate deletion process can be reduced while maintaining encoding efficiency.

  [2] In the candidate deletion process in the merge coding technique, the combined motion information candidates added to the combined motion information candidate list are compared in the order of addition to the list, and the last candidate and the first candidate are further compared. Comparison was made (see steps S3000 to S3018 in FIG. 31).

  [3] In the candidate deletion process in the merge coding technique, the comparison calculation process for determining the identity of the combined motion information candidates included in the combined motion information candidate list is performed a predetermined number of times for a predetermined index ( (See steps S3300 to S3303 in FIG. 35, steps S3700 to S3704 in FIG. 37, FIG. 41, steps S4200 to S4204 in FIG. 43, and FIG. 48).

  [4] In the candidate deletion process in the merge coding technique, when the number of combined motion information candidates generated in the spatial combined information candidate generation process is less than the maximum value, the combined motion of a predetermined index in the combined motion information candidate list The information candidates are added until the number of combined motion information candidates reaches the maximum value, and then the combined motion information is subjected to a candidate comparison operation (see steps S3501 to S3503 in FIG. 38).

  The moving image encoded stream output from the moving image encoding apparatus of the embodiment described above has a specific data format so that it can be decoded according to the encoding method used in the embodiment. Therefore, the moving picture decoding apparatus corresponding to the moving picture encoding apparatus can decode the encoded stream of this specific data format.

  When a wired or wireless network is used to exchange an encoded stream between a moving image encoding device and a moving image decoding device, the encoded stream is converted into a data format suitable for the transmission form of the communication path. It may be transmitted. In that case, a video transmission apparatus that converts the encoded stream output from the video encoding apparatus into encoded data in a data format suitable for the transmission form of the communication channel and transmits the encoded data to the network, and receives the encoded data from the network Then, a moving image receiving apparatus that restores the encoded stream and supplies the encoded stream to the moving image decoding apparatus is provided.

  The moving image transmitting apparatus is a memory that buffers the encoded stream output from the moving image encoding apparatus, a packet processing unit that packetizes the encoded stream, and transmission that transmits the packetized encoded data via the network. Part. The moving image receiving apparatus generates a coded stream by packetizing the received data, a receiving unit that receives the packetized coded data via a network, a memory that buffers the received coded data, and packet processing. And a packet processing unit provided to the video decoding device.

  Further, the above-described processing relating to encoding and decoding can be realized as a transmission, storage, and reception device using hardware, and is stored in a ROM (Read Only Memory), a flash memory, or the like. It can also be realized by firmware or software such as a computer. The firmware program and software program can be recorded on a computer-readable recording medium, provided from a server through a wired or wireless network, or provided as a data broadcast of terrestrial or satellite digital broadcasting Is also possible.

  The present invention has been described based on the embodiments. The embodiments are exemplifications, and it will be understood by those skilled in the art that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are within the scope of the present invention. .

  100 input terminals, 101 subtraction unit, 102 orthogonal transform / quantization unit, 103 prediction error coding unit, 104 inverse quantization / inverse transform unit, 105 addition unit, 106 decoded image memory, 107 motion vector detection unit, 108 motion compensation Prediction unit, 109 prediction mode determination unit, 110 motion information encoding unit, 111 motion information memory, 112 multiplexing unit, 113 output terminal, 600 input terminal, 601 demultiplexing unit, 602 prediction difference information decoding unit, 603 inverse quantization Inverse transformation unit, 604 addition unit, 605 decoded image memory, 606 motion information decoding unit, 607 motion information memory, 608 motion compensation prediction unit, 609 output terminal, 900 motion compensation prediction generation unit, 901 prediction error calculation unit, 902 prediction Vector calculation unit, 903 Difference vector calculation 904 motion information code amount calculation unit 905 prediction mode evaluation unit 906 combined motion information calculation unit 907 combined motion compensation prediction generation unit 1000 spatial combination motion information candidate list generation unit 1001 combined motion information candidate list deletion unit 1002 Temporal combination motion information candidate list generation unit, 1003 first combination motion information candidate list addition unit, 1004 second combination motion information candidate list addition unit, 2600 motion information bitstream decoding unit, 2601 prediction vector calculation unit, 2602 vector addition unit, 2603 Motion Compensated Prediction Decoding Unit, 2604 Combined Motion Information Calculation Unit, 2605 Combined Motion Compensated Prediction Decoding Unit, 4000 Spatial Combined Motion Information Candidate List Generation Unit, 4001 Combined Motion Information Candidate List Delete Unit, 4002 Temporal Combined Motion Information Candidate List Generation Unit , 4003 First combined motion information candidate list adding unit 4004 Second combined motion information candidate list adding unit.

In order to solve the above problems, the moving picture coding apparatus according to one embodiment of the present invention, in blocks each picture is divided moving image data, a video image encoding device for encoding the video data Deriving motion information of an encoded block included in a picture temporally different from a picture having an encoding target block to be encoded, and from the derived motion information of the encoded block Deriving temporal motion information candidates of an encoding target block, deriving a plurality of candidates from motion information of a plurality of encoded neighboring blocks at predetermined positions spatially close to the encoding target block, and the derived derives spatial motion information candidate based on a plurality of candidates, the candidate Li to generate a list of motion information Direction accessory comprising a the derived time motion information candidates and the spatial motion information candidate DOO generating section (906), the prediction mode determination unit determines whether to perform the coding in binding prediction mode for deriving motion information of the encoding target block based on motion information candidates in the list ( 109) and information indicating whether or not to perform the encoding in the joint prediction mode is encoded, and when it is determined that the encoding is performed in the joint prediction mode, predetermined information included in the list is included. the index that specifies the motion information candidate coded, on the basis of the motion information candidates in which the index coded to specify derive the motion information of the encoding target block, encode the encoding target block provided marks Goka section (103, 110). When there is the same motion information among the candidates, the candidate list generation unit (906) derives one spatial motion information candidate from candidates with the same motion information.

Yet another aspect of the present invention is a video encoding method. This method, in blocks each picture is divided moving image data, a moving picture encoding method for encoding the moving image data, and the picture having a coding target block to be subjected to the coding Deriving motion information of an encoded block included in temporally different pictures, deriving temporal motion information candidates of the encoding target block from the derived motion information of the encoded block, and the encoding target A plurality of candidates are derived from motion information of a plurality of adjacent blocks that have been encoded at a predetermined position spatially close to the block, and spatial motion information candidates are derived based on the plurality of derived candidates. a candidate list generating step of generating a list of motion information Direction complement containing said time motion information candidate the spatial motion information candidate motion information candidates included in the list A prediction mode determination step for determining whether to perform the encoding in a joint prediction mode for deriving motion information of the block to be encoded based on the information, and information indicating whether to perform the encoding in the joint prediction mode Is encoded, an index specifying a predetermined motion information candidate included in the list is encoded, and the encoded index is specified. said based on the motion information candidate derives the motion information of the encoding target block, and a mark Goka step you encode the encoding target block. In the candidate list generation step, when there is the same motion information among the candidates, one spatial motion information candidate is derived from candidates having the same motion information.

Claims (10)

A moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculation unit that calculates motion information candidates of the encoding target block and generates a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks including the motion information in the candidate list output from the motion information calculation unit. When a joint prediction mode that uses information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation unit An encoding unit that encodes the encoding target block and encodes an index indicating a designated reference block;
The motion information calculation unit
A spatial candidate list generating unit that calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and generates a motion information candidate list When,
If there are motion information candidates included in the candidate list generated by the spatial candidate list generation unit that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion section to be deleted;
The candidate list processed by the candidate list deletion unit by calculating motion information candidates of the encoding target block using motion information of an encoded adjacent block temporally adjacent to the encoding target block And a time candidate list generation unit to be added to the video encoding device. A moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculation unit that calculates motion information candidates of the encoding target block and generates a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks including the motion information in the candidate list output from the motion information calculation unit. When a joint prediction mode that uses information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation unit An encoding unit that encodes the encoding target block and encodes an index indicating a designated reference block;
The motion information calculation unit
A spatial candidate list generating unit that calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and generates a motion information candidate list When,
If there are motion information candidates included in the candidate list generated by the spatial candidate list generation unit that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion section to be deleted;
The candidate list processed by the candidate list deletion unit by calculating motion information candidates of the encoding target block using motion information of an encoded adjacent block temporally adjacent to the encoding target block A time candidate list generation unit to be added to
The candidate list deletion unit compares adjacent candidates in the order of arrangement of the candidate lists, and compares the highest candidate with the lowest candidate so that at least the motion vector values match each other. A moving picture coding apparatus that determines whether or not. A moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculation unit that calculates motion information candidates of the encoding target block and generates a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks including the motion information in the candidate list output from the motion information calculation unit. When a joint prediction mode that uses information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation unit An encoding unit that encodes the encoding target block and encodes an index indicating a designated reference block;
The motion information calculation unit
A spatial candidate list generating unit that calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and generates a motion information candidate list When,
If there are motion information candidates included in the candidate list generated by the spatial candidate list generation unit that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion section to be deleted;
The candidate list processed by the candidate list deletion unit by calculating motion information candidates of the encoding target block using motion information of an encoded adjacent block temporally adjacent to the encoding target block A time candidate list generation unit to be added to
The candidate list deletion unit determines whether or not there are at least motion vector values that coincide with each other for candidates included from the highest level to a predetermined number in the order of arrangement of the candidate list. Encoding device. A moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculation unit that calculates motion information candidates of the encoding target block and generates a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks including the motion information in the candidate list output from the motion information calculation unit. When a joint prediction mode that uses information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation unit An encoding unit that encodes the encoding target block and encodes an index indicating a designated reference block;
The motion information calculation unit
A spatial candidate list generating unit that calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and generates a motion information candidate list When,
If there are motion information candidates included in the candidate list generated by the spatial candidate list generation unit that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion section to be deleted;
The candidate list processed by the candidate list deletion unit by calculating motion information candidates of the encoding target block using motion information of an encoded adjacent block temporally adjacent to the encoding target block A time candidate list generation unit to be added to
The candidate list deletion unit, when the number of candidates registered in the candidate list is less than a predetermined maximum number of candidates, after duplicating the lowest candidate of the candidate list to fill the empty candidates, the candidate list Comparing adjacent candidates in the order of the sequences, and comparing the highest candidate and the lowest candidate to determine whether there is at least a motion vector value that matches each other. A moving image encoding device. A moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculation unit that calculates motion information candidates of the encoding target block and generates a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks including the motion information in the candidate list output from the motion information calculation unit. When a joint prediction mode that uses information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation unit An encoding unit that encodes the encoding target block and encodes an index indicating a designated reference block;
The motion information calculation unit
A spatial candidate list generating unit that calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and generates a motion information candidate list When,
If there are motion information candidates included in the candidate list generated by the spatial candidate list generation unit that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion section to be deleted;
The candidate list processed by the candidate list deletion unit by calculating motion information candidates of the encoding target block using motion information of an encoded adjacent block temporally adjacent to the encoding target block A time candidate list generation unit to be added to
When the number of candidates registered in the candidate list is 4, the candidate list deletion unit compares adjacent candidates for the third to third in the order of arrangement of the candidate list, and the lowest candidate And the highest candidate, and further comparing the lowest candidate with the second candidate to determine whether or not there is at least a motion vector value that matches each other. Device. A moving image encoding apparatus that encodes the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculation unit that calculates motion information candidates of the encoding target block and generates a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks including the motion information in the candidate list output from the motion information calculation unit. When a joint prediction mode that uses information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation unit An encoding unit that encodes the encoding target block and encodes an index indicating a designated reference block;
The motion information calculation unit
A spatial candidate list generating unit that calculates motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block, and generates a motion information candidate list When,
The candidate processed by the spatial candidate list generation unit by calculating motion information candidates of the encoding target block using motion information of an encoded adjacent block temporally adjacent to the encoding target block A time candidate list generator to be added to the list;
If there are motion information candidates included in the candidate list generated by the time candidate list generation unit that have at least the same motion vector values, one of the motion information candidates is selected from the candidate list. A candidate list deletion section to be deleted,
The candidate list deletion unit determines whether or not there are at least motion vector values that coincide with each other for candidates included from the highest level to a predetermined number in the order of arrangement of the candidate list. Encoding device. A moving image encoding method for encoding the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculating step of calculating motion information candidates of the encoding target block and generating a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks having the motion information in the candidate list output from the motion information calculating step. When joint prediction mode using information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation step An encoding step of encoding the block to be encoded and encoding an index indicating a designated reference block;
The motion information calculating step includes
A spatial candidate list generation step of calculating motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block and generating a motion information candidate list When,
If there are motion information candidates included in the candidate list generated by the spatial candidate list generation step that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion step to be deleted;
The candidate list processed by the candidate list deletion step by calculating motion information candidates of the encoding target block using the motion information of the encoded adjacent block temporally adjacent to the encoding target block And a time candidate list generation step to be added to the video encoding method. A moving image encoding method for encoding the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculating step of calculating motion information candidates of the encoding target block and generating a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks having the motion information in the candidate list output from the motion information calculating step. When joint prediction mode using information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation step An encoding step of encoding the block to be encoded and encoding an index indicating a designated reference block;
The motion information calculating step includes
A spatial candidate list generation step of calculating motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block and generating a motion information candidate list When,
The candidate processed by the spatial candidate list generation step by calculating motion information candidates of the encoding target block using motion information of an encoded adjacent block temporally adjacent to the encoding target block A time candidate list generation step to be added to the list;
If there are motion information candidates included in the candidate list generated by the time candidate list generation step that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion step to be deleted,
The candidate list deleting step determines whether or not there are at least motion vector values that coincide with each other among candidates included from the highest level to a predetermined number in the order of arrangement of the candidate lists. Encoding method. A moving image encoding program for encoding the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculating step of calculating motion information candidates of the encoding target block and generating a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks having the motion information in the candidate list output from the motion information calculating step. When joint prediction mode using information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation step And encoding the block to be encoded and encoding the index indicating the designated reference block, and causing the computer to execute,
The motion information calculating step includes
A spatial candidate list generation step of calculating motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block and generating a motion information candidate list When,
If there are motion information candidates included in the candidate list generated by the spatial candidate list generation step that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion step to be deleted;
The candidate list processed by the candidate list deletion step by calculating motion information candidates of the encoding target block using the motion information of the encoded adjacent block temporally adjacent to the encoding target block And a time candidate list generation step to be added to the video encoding program. A moving image encoding program for encoding the moving image using a motion vector in units of blocks obtained by dividing each picture of the moving image,
A motion information calculating step of calculating motion information candidates of the encoding target block and generating a motion information candidate list;
The motion of the designated reference block is designated by designating one neighboring block as a reference block for referring to the motion information from among the neighboring blocks having the motion information in the candidate list output from the motion information calculating step. When joint prediction mode using information as motion information of the coding target block is selected, using the motion information of the designated reference block obtained from the candidate list output from the motion information calculation step And encoding the block to be encoded and encoding the index indicating the designated reference block, and causing the computer to execute,
The motion information calculating step includes
A spatial candidate list generation step of calculating motion information of a plurality of encoded adjacent blocks spatially adjacent to the encoding target block as motion information candidates of the encoding target block and generating a motion information candidate list When,
The candidate processed by the spatial candidate list generation step by calculating motion information candidates of the encoding target block using motion information of an encoded adjacent block temporally adjacent to the encoding target block A time candidate list generation step to be added to the list;
If there are motion information candidates included in the candidate list generated by the time candidate list generation step that have at least motion vector values that match each other, one of the motion information candidates is selected from the candidate list. A candidate list deletion step to be deleted,
The candidate list deleting step determines whether or not there are at least motion vector values that coincide with each other among candidates included from the highest level to a predetermined number in the order of arrangement of the candidate lists. Encoding program.

Images