WO2012008125A1 - Video encoding device, video decoding device, video encoding method, and video decoding method - Google Patents
Video encoding device, video decoding device, video encoding method, and video decoding method Download PDFInfo
- Publication number
- WO2012008125A1 WO2012008125A1 PCT/JP2011/003907 JP2011003907W WO2012008125A1 WO 2012008125 A1 WO2012008125 A1 WO 2012008125A1 JP 2011003907 W JP2011003907 W JP 2011003907W WO 2012008125 A1 WO2012008125 A1 WO 2012008125A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- intra prediction
- prediction
- encoding
- image
- unit
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/91—Entropy coding, e.g. variable length coding [VLC] or arithmetic coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/103—Selection of coding mode or of prediction mode
- H04N19/11—Selection of coding mode or of prediction mode among a plurality of spatial predictive coding modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/186—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a colour or a chrominance component
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/189—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding
- H04N19/196—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters
- H04N19/198—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the adaptation method, adaptation tool or adaptation type used for the adaptive coding being specially adapted for the computation of encoding parameters, e.g. by averaging previously computed encoding parameters including smoothing of a sequence of encoding parameters, e.g. by averaging, by choice of the maximum, minimum or median value
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/463—Embedding additional information in the video signal during the compression process by compressing encoding parameters before transmission
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/593—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving spatial prediction techniques
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
- H04N19/96—Tree coding, e.g. quad-tree coding
Definitions
- the present invention relates to a moving image encoding device, a moving image decoding device, a moving image encoding method, and a moving image decoding method that perform intra prediction processing or intra prediction processing to perform predictive encoding.
- FIG. 15 is an explanatory diagram illustrating an intra prediction mode when the luminance block size is 4 ⁇ 4 pixels.
- the luminance block size is 4 ⁇ 4 pixels
- nine intra prediction modes from mode 0 to mode 8 are defined.
- mode 2 is an intra prediction mode related to average value prediction, and is a mode in which pixels in an encoding target block are predicted by an average value of adjacent pixels in the upper and left blocks.
- the modes other than mode 2 are intra prediction modes related to directionality prediction.
- Mode 0 is an intra prediction mode related to vertical prediction, and a prediction image is generated by repeating adjacent pixels in the upper block in the vertical direction. For example, mode 0 is selected when the encoding target block has a vertical stripe pattern.
- Mode 1 is an intra prediction mode related to horizontal prediction, and a prediction image is generated by repeating adjacent pixels of the left block in the horizontal direction.
- modes 3 to 8 a predicted image is generated by generating an interpolation pixel in a predetermined direction (direction indicated by an arrow) using adjacent pixels of the upper block or the left block.
- the luminance block size to which the intra prediction is applied can be selected from 4 ⁇ 4 pixels, 8 ⁇ 8 pixels, and 16 ⁇ 16 pixels, and in the case of 8 ⁇ 8 pixels, 4 ⁇ 4 pixels.
- nine intra prediction modes are defined.
- 16 ⁇ 16 pixels in addition to intra prediction modes related to average value prediction, vertical direction prediction, and horizontal direction prediction, four intra prediction modes called plane prediction are defined.
- the intra prediction mode related to the planar prediction is a mode in which a pixel generated by interpolating an adjacent pixel of the upper block and an adjacent pixel of the left block in an oblique direction is used as a prediction value.
- Patent Document 1 discloses a technique that can reduce the amount of code related to the intra prediction mode by using a frequency information table that counts the frequency of occurrence of the intra prediction mode. It is necessary to prepare a frequency information table.
- the conventional video encoding apparatus is configured as described above, if the number of selectable directional prediction modes is increased, the probability that the edge direction matches the direction indicated by the prediction mode increases, and the prediction efficiency is improved. Can be increased. However, if the number of selectable directional prediction modes is increased, there is a problem that the code amount of information related to the intra prediction mode increases.
- the present invention has been made to solve the above-described problems, and an object of the present invention is to provide a moving picture coding apparatus and a moving picture coding method capable of suppressing an increase in the code amount of information related to the intra prediction mode. And Another object of the present invention is to obtain a moving picture decoding apparatus and a moving picture decoding method that can be applied to the above moving picture encoding apparatus and moving picture encoding method.
- the same intra prediction parameter as that used when performing the intra prediction process on the encoding target block of the luminance signal.
- the intra prediction parameter generation unit uses the same intra prediction parameter as the luminance signal as the intra prediction parameter used when the intra prediction process for the encoding target block of the color difference signal is performed.
- a variable length encoding flag indicating whether or not prediction processing is being performed It is obtained by the.
- the prediction image generation means when the predicted image generating means generates a predicted image of the color difference signal, the same intra prediction parameter as the intra prediction parameter used when performing the intra prediction process on the encoding target block of the luminance signal is used.
- the intra-prediction process for the encoding target block of the chrominance signal is performed, or the intra-prediction process for the encoding target block of the chrominance signal is performed by applying the average prediction, and the variable-length encoding means
- the prediction image generation means performs the intra prediction process for the current block to be encoded using the same intra prediction parameter as the luminance signal. Because it is configured to variable-length encode the flag indicating whether or not Without decreasing the prediction efficiency, there is an effect that it is possible to reduce the amount of codes according to the intra prediction mode of the color difference signals.
- luminance is 4x4 pixel.
- FIG. 1 is a block diagram showing a moving picture coding apparatus according to Embodiment 1 of the present invention.
- the block dividing unit 1 divides the input image into blocks having a coding block size determined by the coding control unit 2 (blocks of prediction processing units), A process of outputting an encoding target block that is a block of a prediction processing unit is performed.
- the block dividing unit 1 constitutes a block dividing unit.
- the encoding control unit 2 determines the encoding block size and encodes the encoding target block output from the block dividing unit 1 from one or more selectable intra encoding modes and inter encoding modes. The process of determining the encoding mode with the highest is performed. In addition, when the coding mode having the highest coding efficiency is the intra coding mode, the coding control unit 2 sets the intra prediction parameter used when performing the intra prediction process on the current block in the intra coding mode. When the coding mode having the highest coding efficiency is determined to be the inter coding mode, the inter prediction parameter used when performing the inter prediction process for the current block in the inter coding mode is executed. To do.
- the encoding control unit 2 performs a process of determining a prediction difference encoding parameter to be given to the transform / quantization unit 7 and the inverse quantization / inverse transform unit 8.
- the encoding control unit 2 constitutes an encoding control unit.
- the changeover switch 3 outputs the block to be coded output from the block dividing unit 1 to the intra prediction unit 4, and the coding control unit If the coding mode determined by 2 is the inter coding mode, a process of outputting the coding target block output from the block division unit 1 to the motion compensation prediction unit 5 is performed.
- the intra prediction unit 4 refers to the locally decoded image stored in the intra prediction memory 10 and uses the intra prediction parameter determined by the encoding control unit 2 to output the encoding target block output from the changeover switch 3.
- the intra prediction process is performed on the image to generate an intra predicted image (predicted image).
- the changeover switch 3, the intra prediction unit 4, and the intra prediction memory 10 constitute a predicted image generation unit.
- the motion compensated prediction unit 5 searches the motion vector by comparing the encoding target block output from the changeover switch 3 with the locally decoded image after filtering stored in the motion compensated prediction frame memory 12, and the motion vector Using the inter prediction parameters determined by the encoding control unit 2, an inter prediction process (motion compensation prediction process) is performed on the encoding target block to generate an inter prediction image.
- an inter prediction process motion compensation prediction process
- the subtraction unit 6 subtracts the intra prediction image generated by the intra prediction unit 4 or the inter prediction image generated by the motion compensation prediction unit 5 from the encoding target block output from the block division unit 1, A process of outputting a prediction difference signal (difference image) as a subtraction result to the transform / quantization unit 7 is performed.
- the transform / quantization unit 7 refers to the prediction difference encoding parameter determined by the encoding control unit 2 and performs orthogonal transform processing (for example, DCT (discrete cosine transform)) on the prediction difference signal output from the subtraction unit 6.
- the inverse quantization / inverse transform unit 8 refers to the prediction difference encoding parameter determined by the encoding control unit 2 and inversely quantizes the compressed data output from the transform / quantization unit 7, and the prediction difference
- inverse orthogonal transform processing is performed on the transform coefficient that is compressed data after inverse quantization, and a local decoded prediction difference signal corresponding to the prediction difference signal output from the subtraction unit 6 is calculated.
- the addition unit 9 includes the local decoded prediction difference signal calculated by the inverse quantization / inverse conversion unit 8, the intra prediction image generated by the intra prediction unit 4, or the inter prediction image generated by the motion compensation prediction unit 5. And a process of calculating a locally decoded image corresponding to the encoding target block output from the block dividing unit 1 is performed.
- the intra prediction memory 10 is a recording medium that stores the locally decoded image calculated by the adding unit 9.
- the loop filter unit 11 performs a predetermined filtering process on the local decoded image calculated by the adding unit 9 and performs a process of outputting the local decoded image after the filtering process.
- the motion compensated prediction frame memory 12 is a recording medium that stores a locally decoded image after filtering processing.
- variable length coding unit 13 outputs the compressed data output from the transform / quantization unit 7, the output signal of the coding control unit 2 (coding mode, intra prediction parameter or inter prediction parameter, prediction difference coding parameter),
- the motion vector output from the motion compensation prediction unit 5 (when the encoding mode is the inter encoding mode) is subjected to variable length encoding to generate a bit stream.
- the variable length coding unit 13 uses the intra determined by the coding control unit 2 among the prediction direction vectors related to the plurality of direction predictions in the intra prediction process.
- variable length coding of the prediction parameter the prediction direction vector closest to the prediction direction vector indicated by the intra prediction parameter of the encoding target block determined by the encoding control unit 2 is specified, and the specified prediction direction representative vector Is encoded with variable length, and an index representing the difference between the prediction direction vector and the prediction direction representative vector indicated by the intra prediction parameter of the encoded block is variable length encoded.
- the variable length encoding unit 13 constitutes variable length encoding means.
- a block division unit 1 an encoding control unit 2, a changeover switch 3, an intra prediction unit 4, a motion compensation prediction unit 5, a subtraction unit 6, transform / quantization, which are components of the moving image encoding device.
- FIG. 3 is a flowchart showing the processing contents (moving image coding method) of the moving image coding apparatus according to Embodiment 1 of the present invention.
- FIG. 2 is a block diagram showing the inside of the variable length coding unit 13 of the moving picture coding apparatus according to Embodiment 1 of the present invention.
- the variable length encoding unit 13 includes an intra prediction parameter variable length encoding unit 13a as one of the constituent elements.
- the intra prediction parameter prediction value calculation unit 21 of the intra prediction parameter variable length encoding unit 13a calculates the encoding target block from the intra prediction parameter of the encoded block adjacent to the encoding target block output from the block division unit 1. The process which calculates the predicted value of the intra prediction parameter of is implemented.
- the intra-prediction parameter binarization index calculation unit 22 matches the prediction value calculated by the intra-prediction parameter prediction value calculation unit 21 and the intra-prediction parameter of the block to be encoded with the index of the prediction direction representative vector. In addition to the flag indicating the determination result, if they match, the intra prediction parameter including the difference value between the prediction direction vector and the prediction direction representative vector indicated by the intra prediction parameter of the encoded block If a binary index is calculated, and if they do not match, a process for calculating an intra prediction parameter binarization index including the index of the prediction direction representative vector and the difference value is performed in addition to a flag indicating the determination result. .
- the entropy coding unit 23 performs variable-length coding such as arithmetic coding on the intra prediction parameter binarization index calculated by the intra prediction parameter binarization index calculation unit 22 and outputs an intra prediction parameter codeword To implement.
- FIG. 10 is a block diagram showing a moving picture decoding apparatus according to Embodiment 1 of the present invention.
- the variable length decoding unit 31 receives a bit stream generated by the moving image encoding apparatus
- the variable length decoding unit 31 receives compressed data, an encoding mode, and an intra prediction parameter (the encoding mode is an intra encoding mode) from the bit stream.
- an intra prediction parameter the encoding mode is an intra encoding mode
- inter prediction parameters when the coding mode is the inter coding mode
- prediction differential coding parameters and motion vectors are subjected to variable length decoding. .
- variable length decoding unit 31 performs variable length decoding of the index of the prediction direction representative vector as variable length decoding of the intra prediction parameter, and decodes the decoded block (the moving image in FIG. 1).
- An index representing a difference between a prediction direction vector and a prediction direction representative vector indicated by an intra prediction parameter of a block corresponding to an “encoded block” of the image encoding device is variable-length decoded, and the index of the prediction direction representative vector and the above-described index Processing for determining the intra prediction parameter from the index representing the difference is performed.
- the variable length decoding unit 31 constitutes a variable length decoding unit.
- the inverse quantization / inverse transform unit 32 refers to the prediction difference encoding parameter variable length decoded by the variable length decoding unit 31 and inversely quantizes the compressed data variable length decoded by the variable length decoding unit 31.
- a decoding prediction corresponding to the prediction difference signal output from the subtraction unit 6 of FIG. 1 is performed by referring to the prediction difference encoding parameter and performing an inverse orthogonal transform process on the transform coefficient that is the compressed data after the inverse quantization.
- a process for calculating a differential signal is performed.
- the inverse quantization / inverse transform unit 32 constitutes an inverse quantization means.
- the changeover switch 33 outputs the intra-prediction parameter variable-length decoded by the variable-length decoding unit 31 to the intra-prediction unit 34 if the coding mode variable-length decoded by the variable-length decoding unit 31 is the intra-coding mode. If the encoding mode variable-length decoded by the variable-length decoding unit 31 is an inter-coding mode, a process of outputting the inter prediction parameters and motion vectors variable-length decoded by the variable-length decoding unit 31 to the motion compensation unit 35 carry out.
- the intra prediction unit 34 performs an intra prediction process on the decoding target block using the intra prediction parameter output from the changeover switch 33 while referring to the decoded image stored in the intra prediction memory 37, and performs the intra prediction process. A process of generating (predicted image) is performed.
- the changeover switch 33, the intra prediction unit 34, and the intra prediction memory 37 constitute a predicted image generation unit.
- the motion compensation unit 35 uses the motion vector and the inter prediction parameter output from the changeover switch 33 while referring to the decoded image after filtering stored in the motion compensated prediction frame memory 39, and performs inter prediction on the decoding target block.
- a process motion compensation prediction process
- the addition unit 36 adds the decoded prediction difference signal calculated by the inverse quantization / inverse conversion unit 32 and the intra prediction image generated by the intra prediction unit 34 or the inter prediction image generated by the motion compensation unit 35. Then, a process of calculating a decoded image corresponding to the encoding target block output from the block dividing unit 1 in FIG. 1 is performed.
- the intra prediction memory 37 is a recording medium that stores the decoded image calculated by the addition unit 36.
- the loop filter unit 38 performs a predetermined filtering process on the decoded image calculated by the adding unit 36 and performs a process of outputting the decoded image after the filtering process.
- the motion compensated prediction frame memory 39 is a recording medium that stores the decoded image after the filtering process.
- variable length decoding unit 31 the variable length decoding unit 31, the inverse quantization / inverse conversion unit 32, the changeover switch 33, the intra prediction unit 34, the motion compensation unit 35, the addition unit 36, and the intra prediction that are components of the video decoding device.
- each of the memory 37, the loop filter unit 38, and the motion compensation prediction frame memory 39 is configured by dedicated hardware (for example, a semiconductor integrated circuit on which a CPU is mounted, a one-chip microcomputer, or the like).
- FIG. 12 is a flowchart showing the processing contents (moving image decoding method) of the moving image decoding apparatus according to Embodiment 1 of the present invention.
- FIG. 11 is a block diagram showing the inside of the variable length decoding unit 31 of the moving picture decoding apparatus according to Embodiment 1 of the present invention.
- the variable length decoding unit 31 incorporates an intra prediction parameter variable length decoding unit 31a as one of the components.
- the entropy decoding unit 41 of the intra prediction parameter variable length decoding unit 31a performs a process of variable length decoding the intra prediction parameter binarization index from the intra prediction parameter codeword.
- the intra prediction parameter prediction value calculation unit 42 performs a process of calculating the prediction value of the intra prediction parameter of the decoding target block from the intra prediction parameter of the decoded block adjacent to the decoding target block.
- the intra prediction parameter index calculation unit 43 indicates that the flag included in the intra prediction parameter binarization index variable-length decoded by the entropy decoding unit 41 indicates that the prediction value matches the index of the prediction direction representative vector. Then, the prediction value calculated by the intra prediction parameter prediction value calculation unit 42 and the prediction direction vector and the prediction direction representative vector indicated by the intra prediction parameter of the decoded block included in the intra prediction parameter binarization index are included. If the intra prediction parameter is calculated from the difference value and the flag indicates that the prediction value and the index of the prediction direction representative vector do not match, the prediction value calculated by the intra prediction parameter prediction value calculation unit 42 And its intra prediction parameter binarization And index of the prediction direction representative vectors contained in index, carries out a process of calculating the intra prediction parameter from the above difference value.
- each frame image of a video is used as an input image, motion compensation prediction is performed between adjacent frames, and the obtained prediction difference signal is subjected to compression processing by orthogonal transformation / quantization, and then A moving picture coding apparatus that performs variable length coding to generate a bit stream and a moving picture decoding apparatus that decodes a bit stream output from the moving picture coding apparatus will be described.
- the moving picture coding apparatus in FIG. 1 performs intra-frame / inter-frame adaptive coding by dividing a video signal into blocks of various sizes in response to local changes in the spatial and temporal directions of the video signal. It is characterized by that.
- a video signal has a characteristic that the complexity of the signal changes locally in space and time.
- a small image such as a picture with a uniform signal characteristic in a relatively wide image area such as the sky or a wall, or a picture containing a person or fine texture, on a video frame.
- a pattern having a complicated texture pattern in the region may be mixed.
- Even when viewed temporally, the change in the pattern of the sky and the wall locally in the time direction is small, but because the outline of the moving person or object moves rigidly or non-rigidly in time, the temporal change Is big.
- the encoding process generates a prediction difference difference signal with small signal power and entropy by temporal and spatial prediction, and reduces the overall code amount. If it can be applied uniformly, the code amount of the parameter can be reduced. On the other hand, if the same prediction parameter is applied to a large image region with respect to an image signal pattern having a large temporal and spatial change, the number of prediction differential signals increases because prediction errors increase. . Therefore, in a region where the temporal and spatial changes are large, the block size for performing the prediction process by applying the same prediction parameter is reduced, the amount of parameter data used for prediction is increased, and the power and entropy of the prediction difference signal are increased. It is desirable to reduce
- the first embodiment in order to perform coding adapted to the general characteristics of such a video signal, first, prediction processing or the like is started from a predetermined maximum block size, and the video signal region is divided hierarchically. In addition, the prediction process and the encoding process of the prediction difference are adapted for each divided area.
- the video signal format to be processed by the moving image encoding apparatus of FIG. 1 is a color video signal in an arbitrary color space such as a YUV signal composed of a luminance signal and two color difference signals, or an RGB signal output from a digital image sensor.
- the video frame is an arbitrary video signal including a horizontal / vertical two-dimensional digital sample (pixel) sequence such as a monochrome image signal or an infrared image signal.
- the gradation of each pixel may be 8 bits, or a gradation such as 10 bits or 12 bits.
- a processing data unit corresponding to each frame of the video signal is referred to as a “picture”.
- “picture” is described as a video frame signal that is sequentially scanned (progressive scan).
- the video signal is an interlaced signal
- “picture” is a unit constituting a video frame. It may be a field image signal.
- the encoding control unit 2 determines the size of the maximum encoding block used for encoding the picture to be encoded (current picture) and the upper limit of the number of hierarchies into which the maximum encoding block is divided (FIG. 3). Step ST1).
- the size of the maximum coding block for example, the same size may be determined for all the pictures according to the resolution of the video signal of the input image, or the local motion of the video signal of the input image
- the size difference may be quantified as a parameter, and a small size may be determined for a picture with high motion, while a large size may be determined for a picture with little motion.
- the block dividing unit 1 divides the picture into the picture of the input image with the maximum coding block size determined by the coding control unit 2, and outputs each divided picture.
- the encoding control unit 2 divides each image area of the maximum encoding block size into encoding target blocks having the encoding block size hierarchically until reaching the upper limit of the number of division hierarchies previously determined. Then, the encoding mode for each encoding target block is determined (step ST2).
- FIG. 4 is an explanatory diagram showing an example in which the maximum coding block is hierarchically divided into a plurality of coding target blocks.
- the maximum coding block is a coding target block whose luminance component indicated as “0th layer” has a size of (L 0 , M 0 ).
- the encoding target block is obtained by hierarchically dividing the maximum encoding block as a starting point to a predetermined depth separately defined by a quadtree structure.
- the encoding target block is an image area of size (L n , M n ).
- the encoding modes selectable by the encoding target block B n as represented by m (B n).
- the encoding mode m (B n ) may be configured to use an individual mode for each color component, or common to all color components. It may be configured to use a mode.
- description will be made assuming that it indicates a coding mode for a luminance component of a coding block of a YUV signal and 4: 2: 0 format.
- the coding mode m (B n ) includes one or more intra coding modes (collectively referred to as “INTRA”), one or more inter coding modes (collectively referred to as “INTER”),
- the encoding control unit 2 selects an encoding mode having the highest encoding efficiency for the encoding target block Bn from all the encoding modes available in the picture or a subset thereof. select.
- the encoding target block Bn is divided into one or a plurality of prediction processing units (partitions) by the block dividing unit 1 as shown in FIG.
- a partition belonging to the encoding target block B n is denoted as P i n (i is a partition number in the nth layer).
- How the partitioning of the encoding target block Bn is performed is included as information in the encoding mode m ( Bn ). All partitions P i n are subjected to prediction processing according to the coding mode m (B n ), but individual prediction parameters can be selected for each partition P i n .
- the encoding control unit 2 generates a block division state as illustrated in FIG. 5 for the maximum encoding block, and identifies the encoding target block.
- the shaded area in FIG. 5A shows the distribution of the partitions after the division
- FIG. 5B shows the situation where the encoding mode m (B n ) is assigned by the hierarchical division in a quadtree graph. Yes. Nodes surrounded by ⁇ in FIG. 5B are nodes (encoding target blocks) to which the encoding mode m (B n ) is assigned. Detailed processing of layer division / coding mode determination in the coding control unit 2 will be described later.
- Change-over switch 3 and the coding control unit 2 coding mode m which is determined by (B n) is an intra coding mode (m (B n) ⁇ INTRA), output from the block dividing unit 1
- the encoding target block Bn is output to the intra prediction unit 4.
- the encoding mode m (B n ) determined by the encoding control unit 2 is the inter encoding mode (when m (B n ) ⁇ INTER)
- the block B n is output to the motion compensation prediction unit 5.
- the intra prediction unit 4 has the coding mode m (B n ) determined by the coding control unit 2 in the intra coding mode (when m (B n ) ⁇ INTRA), and the block to be coded is switched from the changeover switch 3.
- B n is received (step ST3)
- the encoding target block B is referred to by using the intra prediction parameter determined by the encoding control unit 2 while referring to the local decoded image stored in the intra prediction memory 10. and implementing intra prediction process for each partition P i n in the n, it generates an intra prediction image P INTRAi n (step ST4).
- intra prediction parameters used for generating the intra prediction image P INTRAi n is a variable from the encoding control unit 2
- the data is output to the long encoding unit 13 and multiplexed into the bit stream. Details of processing contents of the intra prediction unit 4 will be described later.
- the motion compensation prediction unit 5 is the encoding mode m (B n ) determined by the encoding control unit 2 is an inter coding mode (when m (B n ) ⁇ INTER), and the object to be encoded is selected from the changeover switch 3.
- each partition P i n in the encoding target block B n is compared with the locally decoded image after the filtering process stored in the motion compensated prediction frame memory 12, and the motion vector is compared. to explore its using the motion vector and coding inter-prediction parameters determined by the control unit 2, implemented inter prediction processing for each partition P i n in the encoding target block B n, the inter prediction image generating a P INTERi n (step ST5).
- the inter prediction parameters used for generating the inter prediction image P INTERi n the variable from the encoding control unit 2
- the data is output to the long encoding unit 13 and multiplexed into the bit stream.
- the motion vector searched by the motion compensation prediction unit 5 is also output to the variable length encoding unit 13 and multiplexed into the bit stream.
- Subtraction unit 6 upon receiving the encoding target block B n from the block dividing unit 1 from its partition P i n in the encoding target block B n, the intra prediction image P INTRAi n generated by the intra prediction unit 4, or subtracts the inter prediction image P INTERi n generated by the motion compensation prediction unit 5, and outputs the prediction difference signal e i n a subtraction result to the transform and quantization unit 7 (step ST6).
- the transform / quantization unit 7 When receiving the prediction difference signal e i n from the subtraction unit 6, the transform / quantization unit 7 refers to the prediction difference encoding parameter determined by the encoding control unit 2 and is orthogonal to the prediction difference signal e i n . Transformation processing (for example, DCT (discrete cosine transformation) or orthogonal transformation processing such as KL transformation in which a base design is made in advance for a specific learning sequence) is performed to calculate a transformation coefficient. In addition, the transform / quantization unit 7 refers to the prediction difference encoding parameter, quantizes the transform coefficient, and performs the inverse quantization / inverse transform unit 8 and the variable length on the compressed data that is the transform coefficient after quantization. It outputs to the encoding part 13 (step ST7).
- the inverse quantization / inverse transform unit 8 When receiving the compressed data from the transform / quantization unit 7, the inverse quantization / inverse transform unit 8 refers to the prediction difference encoding parameter determined by the encoding control unit 2 and dequantizes the compressed data. .
- the inverse quantization / inverse transform unit 8 refers to the prediction differential encoding parameter and performs inverse orthogonal transform processing (for example, inverse DCT, inverse KL transform) on the transform coefficient that is the compressed data after inverse quantization. And a local decoded prediction difference signal corresponding to the prediction difference signal e i n output from the subtraction unit 6 is calculated (step ST8).
- the adding unit 9 Upon receiving the local decoded prediction difference signal from the inverse quantization / inverse transform unit 8, the adding unit 9 receives the local decoded prediction difference signal and the intra predicted image P INTRAi n generated by the intra prediction unit 4 or motion compensation. by adding the inter prediction image P INTERi n generated by the prediction unit 5, the local decoded partition image, or as a collection of the local decoded partition image, the encoding target block B n output from the block dividing unit 1 A corresponding local decoded image is calculated (step ST9). The adding unit 9 outputs the locally decoded image to the loop filter unit 11 and stores the locally decoded image in the intra prediction memory 10. This locally decoded image becomes an image signal for subsequent intra prediction.
- the loop filter unit 11 When the loop filter unit 11 receives the local decoded image from the adding unit 9, the loop filter unit 11 performs a predetermined filtering process on the local decoded image and stores the local decoded image after the filtering process in the motion compensated prediction frame memory 12. (Step ST10).
- the filtering process by the loop filter unit 11 may be performed in units of the maximum encoded block or individual encoded blocks of the input local decoded image, or a local decoded image corresponding to a macroblock for one screen is input. After being done, it may be performed for one screen at a time.
- variable length encoding unit 13 When the variable length encoding unit 13 completes the processes of steps ST3 to ST9 for all the encoding target blocks Bn (steps ST11 and ST12), the variable length encoding unit 13 and the encoding control are performed.
- a stream is generated (step ST13). Details of processing contents of the variable length coding unit 13 will be described later.
- FIG. 6 is an explanatory diagram showing an example of each partition P i n-selectable intra prediction parameters of the encoding target block B n (intra prediction mode). 6 shows the intra prediction mode and the prediction direction vector indicated by the intra prediction mode. In the example of FIG. 6, the relative angle between the prediction direction vectors decreases as the number of selectable intra prediction modes increases. Designed to be
- Intra prediction unit 4 as described above, with reference to the intra prediction parameters partitions P i n, to implement intra prediction processing for the partition P i n, but to generate an intra prediction image P INTRAi n, where in, on the basis of the intra prediction parameters (intra prediction mode) for the luminance signal partitions P i n, described intra process of generating an intra prediction signal of the luminance signal.
- the pixel (2 ⁇ l i n +1) pieces of coded upper partition adjacent to the partition P i n as pixels used for predicting a pixel (2 ⁇ m i n) pieces of the left partition
- the number of pixels used for prediction may be more or less than the pixels shown in FIG.
- pixels for one row or one column adjacent to each other are used for prediction, but pixels of two rows, two columns, or more may be used for prediction.
- the index value of the intra prediction mode for the partition P i n is 2 (average value prediction)
- the average value of the adjacent pixels of the upper partition and the adjacent pixels of the left partition is predicted as the predicted value of the pixels in the partition P i n Generate an image.
- the integer pixel When the reference pixel is at the integer pixel position, the integer pixel is set as the prediction value of the prediction target pixel. When the reference pixel is not at the integer pixel position, an interpolation pixel generated from the integer pixel adjacent to the reference pixel is selected. Predicted value. In the example of FIG. 7, since the reference pixel is not located at the integer pixel position, an average value of two pixels adjacent to the reference pixel is set as a predicted value. Note that an interpolation pixel may be generated not only from two adjacent pixels but also from two or more adjacent pixels, and used as a predicted value. In a similar procedure, to generate a predicted pixel for all the pixels of the luminance signal in the partition P i n outputs an intra prediction image P INTRAi n. Incidentally, the intra prediction parameters used for generating the intra prediction image P INTRAi n is outputted to the variable length coding unit 13 for multiplexing the bitstream.
- the intra processing performed based on the intra prediction parameters (intra prediction mode), the variable intra prediction parameter used to generate the intra-prediction image
- the data is output to the long encoding unit 13.
- Variable length coding unit 13 calculates a predicted value of intra prediction parameters partitions P i n to be encoded Then, predictive encoding is performed using the predicted value. That is, the intra prediction parameter prediction value calculation unit 21 of the intra prediction parameter variable length encoding unit 13a constituting a part of the variable length encoding unit 13 performs coding based on the intra prediction parameters of the encoded peripheral partitions. The prediction value of the intra prediction parameter of the partition P i n to be converted is calculated.
- FIG. 8 is an explanatory diagram showing an example of encoded peripheral partition used for calculating the predicted value of intra prediction parameters partitions P i n.
- the left partition P i n (A), above (B), upper right (C), are used intra prediction parameters partition the upper left (D) for the calculation of the predicted value.
- FIG. 6 The process in which the intra prediction parameter prediction value calculation part 21 calculates a prediction value is demonstrated to the case where the number of intra prediction modes is 17 types shown in FIG. 6 as an example.
- 17 types of intra prediction modes include an average value prediction mode and 16 types of direction prediction modes.
- FIG. 9 is an explanatory diagram showing an example of prediction direction vectors in 16 types of directional prediction modes excluding index values and average value predictions in 17 types of intra prediction modes. It is assumed that a prediction direction representative vector indicating a representative direction out of 16 types of prediction direction vectors is determined in advance. In the following description, a case where nine prediction direction vectors “0” to “8” shown in FIG. 9 are predetermined as prediction direction representative vectors will be described as an example.
- the intra prediction parameter prediction value calculation unit 21 calculates a prediction direction representative index from the intra prediction mode of the encoded peripheral partition used for calculation of the prediction value.
- the prediction direction representative index of the directionality prediction mode is an index of the prediction direction representative vector having the smallest relative angle with respect to the prediction direction vector indicated by the directionality prediction mode. That is, the index value of the prediction direction representative vector whose direction is close to that of the prediction direction vector indicated by the directionality prediction mode.
- the prediction direction representative index in the average value prediction mode is the index value of itself (average value prediction mode).
- FIG. 9 shows prediction direction representative indexes of 17 types of intra prediction modes. Furthermore, a prediction direction difference index is assigned to an intra prediction mode index having the same prediction direction representative index.
- the left peripheral partition partition P i n used for calculating the predicted value (A), in the case where a partition above (B), upper right (C), top left (D), the partition A, B, C, D
- the prediction direction representative index is set to m A , m B , m C , and m D , respectively, statistics values such as mode values, minimum values, and medians of m A , m B , m C , and m D are preliminarily stored.
- the determined statistical value is set as a predicted value pm p .
- the prediction direction representative index drawning direction of the prediction direction representative vectors represent a lower left oblique 8 in the example of 9, as the predicted value pm p partitions P i n.
- a prediction direction representative index of one partition determined in advance from among the A, B, C, and D partitions may be used as the predicted value pm p .
- a prediction direction representative index (for example, an index in the average value prediction mode) determined in advance may be used as the prediction value pm p without using the prediction direction representative index of the peripheral partition. Then, the calculated prediction value pm p is output to the intra prediction parameter binarization index calculation unit 22.
- Intra prediction parameters binarization index calculation unit 22 receives a coded partition P i n intra prediction parameters with m p (index of an intra prediction mode) the predicted value pm p, intra prediction parameters binarization index Calculate dm p .
- m p index of an intra prediction mode
- rm p be the prediction direction representative index of the intra prediction mode mp.
- the prediction direction difference index of the intra prediction mode m p is set to dr p , and the processing based on the following expression is further performed on the intra prediction parameter binarization index dm p .
- the first bit is a flag bit indicating whether the prediction direction representative index rm p of the intra prediction mode matches the prediction value pm p ( In the above calculation formula, “0” is assigned if they match, and “1” is assigned if they do not match).
- 2 ⁇ (k + 1) bits of the intra prediction parameters binarization index dm p becomes the bits representing the prediction direction difference index value .
- the entropy encoding unit 23 converts the intra prediction parameter binarization index dm p output from the intra prediction parameter binarization index calculation unit 22 for each prediction direction representative index rm p and each prediction direction difference index. Depending on the situation, the context is switched to perform Huffman coding such as arithmetic coding.
- the intra prediction parameter codeword that is the encoding result is multiplexed into a bitstream by a bitstream multiplexing unit (not shown) of the variable length encoding unit 13.
- coding 1 encodes a representative prediction direction vector (prediction direction representative) from prediction direction vectors of a plurality of directional predictions when encoding intra prediction parameters.
- Vector and the intra prediction parameters are represented by an index of the prediction direction representative vector (prediction direction representative index) and an index representing the difference from the prediction direction representative vector (prediction direction difference index), and the probability for each index.
- Huffman coding such as arithmetic coding according to the model, coding can be performed with a reduced code amount.
- variable length decoding unit 31 receives the bitstream generated by the moving picture encoding device in FIG. 1, the variable length decoding unit 31 performs variable length decoding processing on the bitstream (step ST21 in FIG. 12), and a picture of one frame or more.
- the frame size information is decoded in sequence units or picture units.
- the variable length decoding unit 31 determines the maximum coding block size and the upper limit of the number of divided layers determined by the coding control unit 2 of the moving picture coding apparatus in FIG. 1 in the same procedure as the moving picture coding apparatus. (Step ST22). For example, when the maximum encoding block size is determined according to the resolution of the video signal, the maximum encoding block size is determined based on the decoded frame size information in the same procedure as the moving image encoding apparatus. When the maximum encoding block size and the upper limit of the number of division layers are multiplexed on the bit stream on the moving image encoding device side, values decoded from the bit stream are used. As shown in FIG.
- the moving image encoding apparatus is configured to encode an encoding mode and a conversion / conversion in units of encoding target blocks obtained by hierarchically dividing a maximum encoding block into a plurality of encoding target blocks starting from a starting point.
- the compressed data obtained by quantization is multiplexed into a bit stream.
- the variable length decoding unit 31 that has received the bit stream decodes the division state of the maximum coding block included in the coding mode in the determined maximum coding block unit. Based on the decoded division state, a decoding target block (a block corresponding to the “encoding target block” of the moving image encoding apparatus in FIG. 1) is identified hierarchically (step ST23).
- variable length decoding unit 31 decodes the encoding mode assigned to the encoding target block. Based on the information included in the decoded encoding mode, the encoding target block is further divided into one or more prediction processing units, and the prediction parameter assigned to the prediction processing unit is decoded (step ST24).
- the variable length decoding unit 31 is included in the decoding target block (encoding target block), and the prediction process
- the intra prediction parameter is decoded for each of one or more partitions as a unit. Decoding the intra prediction parameters is based on the intra prediction parameters decoded partition near the same procedure as the video encoding apparatus calculates a predicted value of intra prediction parameters partitions P i n is decoded, the prediction Decode using the value.
- the entropy decoding unit 41 in the intra prediction parameter variable length decoding unit 31a that constitutes a part of the variable length decoding unit 31 inputs the intra prediction parameter codeword included in the bitstream, and the intra prediction The intra prediction parameter binarization index is variable-length decoded from the parameter codeword.
- the intra prediction parameter prediction value calculation unit 42 performs the same procedure as the intra prediction parameter prediction value calculation unit 21 of the video encoding device, and determines the decoding target block from the intra prediction parameters of the decoded blocks adjacent to the decoding target block. A prediction value of the intra prediction parameter is calculated.
- the intra prediction parameter index calculation unit 43 calculates an intra prediction parameter from the intra prediction parameter binarization index variable-length decoded by the entropy decoding unit 41 and the prediction value calculated by the intra prediction parameter prediction value calculation unit 42. To do. Hereinafter, a method for calculating the intra prediction parameter will be described.
- the intra prediction parameter index calculation unit 43 calculates a prediction direction representative index and a prediction direction difference index in order to calculate an intra prediction parameter index.
- intra prediction parameter binarization index be dm p .
- the prediction value pm p is set as the prediction direction representative index value rm p .
- the first bit of the intra-prediction parameter binarization index dm p is “1”
- 2 to (k + 1) bits are subsequently decoded
- the value RM p obtained by decoding 2 to (n + 1) bits is
- the prediction direction representative index value rm p is calculated by the equation.
- the intra prediction parameter index calculation unit 43 decodes the second to (k + 1) th bits, and the first bit is “1”. In this case, the (n + 2) to (n + k + 1) -th bits are decoded, and the decoded value is set as a prediction direction difference index dr p .
- the intra prediction parameter index is decoded based on the prediction direction representative index and the prediction direction difference index, similarly to the video encoding device.
- the variable length decoding unit 31 includes one or more partitions that are included in the decoding target block (encoding target block) and serve as a prediction processing unit. Inter prediction parameters are decoded every time.
- the variable length decoding unit 31 further divides the partition serving as the prediction processing unit into one or a plurality of partitions serving as the transform processing unit based on the information of the transform block size included in the prediction differential encoding parameter.
- the compressed data (transformed / transformed transform coefficient) is decoded for each partition (step ST24).
- variable-length decoded by the variable-length decoding unit 31 is an intra-encoding mode (when m (B n ) ⁇ INTRA)
- the changeover switch 33 is changed by the variable-length decoding unit 31.
- the variable length decoded intra prediction parameter is output to the intra prediction unit 34.
- variable length decoded coding mode m (B n) is if the inter coding mode by the variable length decoding unit 31, variable length decoding by the variable length decoding unit 31
- the inter prediction parameter and the motion vector thus output are output to the motion compensation unit 35.
- the intra prediction unit 34 is an intra coding mode when the coding mode m (B n ) variable-length decoded by the variable length decoding unit 31 is m (B n ) ⁇ INTRA, and the intra prediction is performed from the changeover switch 33.
- the intra prediction parameters output from the changeover switch 33 while referring to the local decoded image stored in the intra prediction memory 37 in the same procedure as the intra prediction unit 4 in FIG. using, by implementing the intra prediction process for each partition P i n the decoding target block B n, it generates an intra prediction image P INTRAi n (step ST26).
- the motion compensation unit 35 encodes from the changeover switch 33 when the encoding mode m (B n ) variable-length decoded by the variable-length decoding unit 31 is an inter encoding mode (when m (B n ) ⁇ INTER).
- the motion vector output from the changeover switch 33 and the inter prediction parameter are used while referring to the decoded image after the filtering process stored in the motion compensated prediction frame memory 39. , by carrying out inter-prediction process for the decoding target block to generate an inter prediction image P INTERi n (step ST27).
- the inverse quantization / inverse conversion unit 32 When receiving the compressed data and the prediction difference encoding parameter from the variable length decoding unit 31, the inverse quantization / inverse conversion unit 32 performs the prediction difference encoding in the same procedure as the inverse quantization / inverse conversion unit 8 of FIG. With reference to the parameters, the compressed data is inversely quantized, and with reference to the prediction differential encoding parameter, the inverse orthogonal transform process is performed on the transform coefficient that is the compressed data after the inverse quantization. The decoded prediction difference signal corresponding to the prediction difference signal output from the subtraction unit 6 is calculated (step ST28).
- Addition unit 36 decodes the prediction difference signal calculated by the inverse quantization and inverse transform unit 32, an intra prediction image P INTRAi n generated by the intra prediction unit 34 or, inter prediction generated by the motion compensation unit 35 by adding the image P INTERi n, as a collection of one or more of the decoded partition image included in the decoding target block, and outputs the decoded image to the loop filter unit 38, a memory 37 for intra prediction the decoded image (Step ST29). This decoded image becomes an image signal for subsequent intra prediction.
- step ST30 When the processing of steps ST23 to ST29 for all the decoding target blocks Bn is completed (step ST30), the loop filter unit 11 performs a predetermined filtering process on the decoded image output from the adding unit 36, The decoded image after the filtering process is stored in the motion compensated prediction frame memory 39 (step ST31). This decoded image becomes a reference image for motion compensation prediction and also becomes a reproduced image.
- variable length decoding unit 31 of the moving picture decoding apparatus in FIG. 10 selects a representative prediction direction vector (prediction direction representative vector) selected from the prediction direction vectors of a plurality of directional predictions. ) And the index (prediction direction difference index) representing the difference from the prediction direction representative vector are entropy-decoded by arithmetic decoding or the like according to each probability model, thereby reducing the code amount. Intra prediction parameters can be correctly decoded.
- the variable length coding unit 13 of the moving picture coding apparatus performs block division among prediction direction vectors related to a plurality of direction predictions in intra prediction processing.
- a prediction direction vector prediction direction representative vector
- the index of the prediction direction representative vector is variable length coded and the difference between the prediction direction vector and the prediction direction representative vector indicated by the intra prediction parameter of the encoded block Since the index indicating the variable length coding is configured, a selectable direction prediction mode is selected. Greater numbers, an effect that it is possible to suppress an increase in code amount of information relating to the intra prediction mode.
- variable length decoding unit 31 of the moving picture decoding apparatus performs variable length decoding of the index of the prediction direction representative vector as variable length decoding of the intra prediction parameter, and intra of the decoded block.
- the index representing the difference between the prediction direction vector indicated by the prediction parameter and the prediction direction representative vector is variable-length decoded, and the intra prediction parameter is determined from the index representing the prediction direction representative vector and the index representing the difference. Therefore, there is an effect that the encoded bitstream can be correctly decoded by reducing the code amount of the intra prediction parameter without reducing the prediction efficiency.
- the intra prediction unit 4 of the moving image encoding apparatus handles the luminance signal and the color difference signal in the video signal in the same manner, and performs the intra prediction process for the encoding target block of the luminance signal and the encoding of the color difference signal. Intra prediction processing for the target block is performed independently. For this reason, the variable length coding unit 13 performs the intra prediction process for the intra prediction process used for the encoding target block of the luminance signal and the intra prediction process for the coding target block of the color difference signal. Intra prediction parameters used in the above are individually variable-length coded and multiplexed into a bitstream.
- the characteristics of the luminance signal encoding target block and the color difference signal encoding target block are approximate, and the intra prediction parameters used when performing the intra prediction processing on both of the encoding target blocks.
- the intra prediction parameters multiplexed in the bit stream are redundant.
- the intra prediction unit 4 when the intra prediction unit 4 generates a color difference signal prediction image, for example, the characteristics of the luminance signal encoding target block and the color difference signal encoding target block are approximated.
- the intra prediction process for the coding target block of the color difference signal using the same intra prediction parameter as the intra prediction parameter used when the intra prediction process for the coding target block of the luminance signal is performed, An example of reducing intra prediction parameters multiplexed in a stream will be described.
- FIG. 13 is an explanatory diagram showing an example of the partition P i n the luminance signal and color difference signals.
- Intra prediction unit 4 of the moving picture coding apparatus includes, as shown in FIG. 13 (a), if the luminance signal partitions P i n (Y) there is an edge, also the color difference signals (Cb, Cr) The intra prediction parameter applied by the luminance signal is applied as it is as the intra prediction parameter of the chrominance signal to generate an intra prediction image.
- FIG. 13 (b) even if there is an edge in the luminance signal of the partition P i n (Y), there is no edge in the case of the edge of the gray scale, color difference signals (Cb, Cr) There is also. In such a case, the intra prediction image is generated by applying the average value prediction without applying the intra prediction parameter of the luminance signal.
- the prediction residual becomes large in the pixels in the region where the edge boundary is blurred or broken, and the amount of code related to the prediction residual increases. Therefore, in order to avoid the occurrence of a situation in which the amount of code related to the prediction residual increases, as shown in FIG. 14, the same intra prediction parameters as the intra prediction parameters used when the intra prediction process is performed on the coding target block of the luminance signal.
- a prediction image is generated by performing intra prediction processing on a coding target block of a color difference signal using a prediction parameter, and then a smoothing filter is applied to the prediction image so as to blur an edge.
- the predicted image after the filter process is a predicted image of the color difference signal.
- the variable-length coding unit 13 performs variable-length coding on the intra prediction parameter applied to the luminance signal and multiplexes it into the bitstream, as in the first embodiment, but the intra-prediction applied to the color difference signal.
- the parameters are as follows. That is, the variable length coding unit 13 does not perform variable length coding on the intra prediction parameter itself applied in the chrominance signal, and uses the same intra prediction parameter as the luminance signal instead of the intra prediction parameter.
- a 1-bit flag indicating whether intra prediction processing is performed on the current block to be encoded or whether average value prediction is applied is entropy-encoded by arithmetic encoding or the like.
- a 1-bit flag is multiplexed into the bitstream as an intra prediction parameter applied in the color difference signal. If necessary, when a smoothing filter is applied to a predicted image, a 1-bit flag indicating whether or not the smoothing filter is applied is entropy-encoded by arithmetic encoding or the like.
- the intra prediction unit 4 generates the intra prediction image by applying the average value prediction when the intra prediction parameter of the luminance signal is not applied when the prediction image of the color difference signal is generated.
- a prediction image may be generated by applying a mode (directional prediction mode) corresponding to a plurality of representative prediction direction vectors such as horizontal prediction and vertical prediction.
- An image obtained by applying a smoothing filter to a predicted image generated by applying the directionality prediction mode may be used as a predicted image of a color difference signal.
- the variable length decoding unit 31 of the moving picture decoding apparatus in FIG. 10 performs variable length decoding of a 1-bit flag from the bitstream as an intra prediction parameter applied with the color difference signal.
- the intra prediction unit 34 indicates that the flag variable-length decoded by the variable-length decoding unit 31 is performing intra prediction processing on the encoding target block of the color difference signal using the same intra prediction parameters as the luminance signal. 1, similarly to the intra prediction unit 4 in FIG. 1, using the same intra prediction parameters as the luminance signal, intra prediction processing is performed on the decoding target block (encoding target block) of the chrominance signal to predict the chrominance signal. Generate an image.
- the intra prediction process is not performed on the encoding target block of the color difference signal using the same intra prediction parameter as the luminance signal.
- average prediction is applied, and intra prediction processing is performed on the decoding target block of the color difference signal to generate a prediction image of the color difference signal.
- horizontal prediction or vertical prediction
- horizontal prediction is applied to perform intra prediction processing on the decoding target block of the color difference signal. It implements and produces
- the intra prediction unit 34 indicates that the flag is applied with the smoothing filter. If the same intra prediction parameter as the luminance signal is used, intra prediction processing is performed on the decoding target block of the color difference signal to generate a prediction image of the color difference signal, and then a smoothing filter is applied to the prediction image. Make a call. In this case, the predicted image after the filter process is a predicted image of the color difference signal.
- the intra prediction process for the encoding target block of the luminance signal is performed.
- Intra prediction processing is performed, and the intra prediction unit 4 uses the same intra prediction parameters as the luminance signal as the intra prediction parameters used when the variable length encoding unit 13 performs the intra prediction processing for the encoding target block of the color difference signal.
- variable-length coding a flag indicating an effect that may be without decreasing the prediction efficiency, to reduce the amount of codes according to the intra prediction mode of the color difference signals.
- the intra prediction unit 4 of the video encoding device performs the intra prediction process on the encoding target block of the color difference signal to generate the prediction image of the color difference signal, Since the smoothing filter is applied to the predicted image, the prediction efficiency can be improved and the code amount of the residual signal can be reduced.
- variable length decoding unit 31 of the video decoding device performs variable length decoding of the flag from the bitstream
- the intra prediction unit 34 stores the flag variable length decoded by the variable length decoding unit 31. If the same intra prediction parameter as that of the luminance signal is used to indicate that intra prediction processing is performed on the encoding target block of the chrominance signal, the decoding of the chrominance signal is performed using the same intra prediction parameter as that of the luminance signal. Intra prediction processing for the target block (coding target block) is performed to generate a color difference signal prediction image, and the flag uses the same intra prediction parameters as the luminance signal, and intra prediction for the color difference signal encoding target block is performed.
- average value prediction is applied to the decoding target block of the color difference signal. Since the intra-prediction process is performed to generate the prediction image of the color difference signal, the encoded bitstream is correctly generated by reducing the code amount of the intra prediction parameter of the color difference signal without reducing the prediction efficiency. The effect which can be decoded is produced.
- the intra prediction unit 34 of the video decoding device performs intra prediction processing on the decoding target block of the color difference signal to generate a predicted image of the color difference signal, and then performs the prediction. Since the smoothing filter is applied to the image, it is possible to increase the prediction efficiency and reduce the amount of code related to the residual signal, thereby correctly decoding the encoded bitstream.
- the moving picture coding apparatus, the moving picture decoding apparatus, the moving picture coding method, and the moving picture decoding method according to the present invention have the code amount according to the intra prediction mode of the chrominance signal without reducing the prediction efficiency. Therefore, a moving picture coding apparatus, a moving picture decoding apparatus, a moving picture coding method, a moving picture decoding method, and the like that perform predictive coding by performing intra prediction processing or inter prediction processing, etc. Suitable for use in.
- 1 block division unit (block division unit), 2 encoding control unit (encoding control unit), 3 changeover switch (prediction image generation unit), 4 intra prediction unit (prediction image generation unit), 5 motion compensation prediction unit, 6 Subtraction unit (quantization means), 7 transformation / quantization unit (quantization means), 8 inverse quantization / inverse transformation unit, 9 addition unit, 10 intra prediction memory (prediction image generation unit), 11 loop filter unit, 12 motion compensation prediction frame memory, 13 variable length coding unit (variable length coding means), 13a intra prediction parameter variable length coding unit, 21 intra prediction parameter prediction value calculation unit, 22 intra prediction parameter binarization index calculation unit , 23 Entropy encoding unit, 31 Variable length decoding unit (variable length decoding means), 31a Intra prediction parameter variable length recovery Unit, 32 inverse quantization / inverse transform unit (inverse quantization unit), 33 changeover switch (prediction image generation unit), 34 intra prediction unit (prediction image generation unit), 35 motion compensation unit, 36 addition unit, 37 intra prediction Memory (predicted image generating means), 38 loop filter
Abstract
Description
輝度のイントラ予測モードでは、複数の予測モードの中から、ブロック単位に1つの予測モードを選択することができる。
図15は輝度のブロックサイズが4×4画素の場合のイントラ予測モードを示す説明図である。
輝度のブロックサイズが4×4画素の場合には、モード0からモード8の9つのイントラ予測モードが規定されている。 Of the intra prediction processes performed by the video encoding apparatus, AVC / H. The intra prediction mode in the H.264 encoding method will be described.
In the luminance intra prediction mode, one prediction mode can be selected for each block from a plurality of prediction modes.
FIG. 15 is an explanatory diagram illustrating an intra prediction mode when the luminance block size is 4 × 4 pixels.
When the luminance block size is 4 × 4 pixels, nine intra prediction modes from
ただし、モード2は平均値予測に係るイントラ予測モードであり、上と左のブロックの隣接画素の平均値で、符号化対象ブロック内の画素を予測するモードである。モード2以外のモードは方向性予測に係るイントラ予測モードである。 In the example of FIG. 15, white circles are pixels in a block to be encoded, and black circles are pixels used for prediction, and are pixels in an adjacent block that has been encoded.
However,
また、モード1は水平方向予測に係るイントラ予測モードであり、左のブロックの隣接画素を水平方向に繰り返すことにより、予測画像を生成する。
モード3からモード8は、上のブロック又は左のブロックの隣接画素を用いて、所定の方向(矢印で示す方向)に補間画素を生成することにより、予測画像を生成する。
In
これに対し、16×16画素の場合には、平均値予測、垂直方向予測及び水平方向予測に係るイントラ予測モードに加えて、平面予測と呼ばれる4つのイントラ予測モードが規定されている。
平面予測に係るイントラ予測モードは、上のブロックの隣接画素と左のブロックの隣接画素を斜め方向に内挿補間して生成した画素を予測値とするモードである。 Here, the luminance block size to which the intra prediction is applied can be selected from 4 × 4 pixels, 8 × 8 pixels, and 16 × 16 pixels, and in the case of 8 × 8 pixels, 4 × 4 pixels. Similarly, nine intra prediction modes are defined.
On the other hand, in the case of 16 × 16 pixels, in addition to intra prediction modes related to average value prediction, vertical direction prediction, and horizontal direction prediction, four intra prediction modes called plane prediction are defined.
The intra prediction mode related to the planar prediction is a mode in which a pixel generated by interpolating an adjacent pixel of the upper block and an adjacent pixel of the left block in an oblique direction is used as a prediction value.
ただし、ブロック内のオブジェクトのエッジの方向が、予測モードが示す方向と一致しなければ、予測効率が低下するため、符号量を削減することができない。
以下の特許文献1には、イントラ予測モードの発生頻度をカウントしている頻度情報テーブルを使用すれば、イントラ予測モードに係る符号量を削減することができる技術を開示しているが、予め、頻度情報テーブルを用意する必要がある。 Note that in the directionality prediction mode when the block size is 4 × 4 pixels or 8 × 8 pixels, a prediction value is generated in a predetermined direction (for example, a direction of 45 degrees). If the direction of the boundary (edge) coincides with the direction indicated by the prediction mode, the prediction efficiency increases and the amount of codes can be reduced.
However, if the direction of the edge of the object in the block does not coincide with the direction indicated by the prediction mode, the prediction efficiency decreases, and therefore the code amount cannot be reduced.
The following
また、この発明は、上記の動画像符号化装置及び動画像符号化方法に適用することができる動画像復号装置及び動画像復号方法を得ることを目的とする。 The present invention has been made to solve the above-described problems, and an object of the present invention is to provide a moving picture coding apparatus and a moving picture coding method capable of suppressing an increase in the code amount of information related to the intra prediction mode. And
Another object of the present invention is to obtain a moving picture decoding apparatus and a moving picture decoding method that can be applied to the above moving picture encoding apparatus and moving picture encoding method.
実施の形態1.
図1はこの発明の実施の形態1による動画像符号化装置を示す構成図である。
図1において、ブロック分割部1は入力画像を示す映像信号を入力すると、その入力画像を符号化制御部2により決定された符号化ブロックサイズのブロック(予測処理単位のブロック)に分割して、予測処理単位のブロックである符号化対象ブロックを出力する処理を実施する。なお、ブロック分割部1はブロック分割手段を構成している。 Hereinafter, in order to explain the present invention in more detail, modes for carrying out the present invention will be described with reference to the accompanying drawings.
1 is a block diagram showing a moving picture coding apparatus according to
In FIG. 1, when a video signal indicating an input image is input, the
また、符号化制御部2は符号化効率が最も高い符号化モードがイントラ符号化モードである場合、そのイントラ符号化モードで符号化対象ブロックに対するイントラ予測処理を実施する際に用いるイントラ予測パラメータを決定し、符号化効率が最も高い符号化モードがインター符号化モードである場合、そのインター符号化モードで符号化対象ブロックに対するインター予測処理を実施する際に用いるインター予測パラメータを決定する処理を実施する。
さらに、符号化制御部2は変換・量子化部7及び逆量子化・逆変換部8に与える予測差分符号化パラメータを決定する処理を実施する。
なお、符号化制御部2は符号化制御手段を構成している。 The
In addition, when the coding mode having the highest coding efficiency is the intra coding mode, the
Further, the
The
なお、切換スイッチ3、イントラ予測部4及びイントラ予測用メモリ10から予測画像生成手段が構成されている。 The
The
変換・量子化部7は符号化制御部2により決定された予測差分符号化パラメータを参照して、減算部6から出力された予測差分信号に対する直交変換処理(例えば、DCT(離散コサイン変換)や、予め特定の学習系列に対して基底設計がなされているKL変換等の直交変換処理)を実施して変換係数を算出するとともに、その予測差分符号化パラメータを参照して、その変換係数を量子化し、量子化後の変換係数である圧縮データ(差分画像の量子化係数)を逆量子化・逆変換部8及び可変長符号化部13に出力する処理を実施する。
なお、減算部6及び変換・量子化部7から量子化手段が構成されている。 The
The transform /
The subtracting
加算部9は逆量子化・逆変換部8により算出された局所復号予測差分信号と、イントラ予測部4により生成されたイントラ予測画像、または、動き補償予測部5により生成されたインター予測画像とを加算して、ブロック分割部1から出力された符号化対象ブロックに相当する局所復号画像を算出する処理を実施する。 The inverse quantization /
The
ループフィルタ部11は加算部9により算出された局所復号画像に対して、所定のフィルタリング処理を実施して、フィルタリング処理後の局所復号画像を出力する処理を実施する。
動き補償予測フレームメモリ12はフィルタリング処理後の局所復号画像を格納する記録媒体である。 The
The
The motion compensated
ただし、可変長符号化部13は、符号化モードがイントラ符号化モードである場合、イントラ予測処理における複数の方向性予測に係る予測方向ベクトルの中で、符号化制御部2により決定されたイントラ予測パラメータの可変長符号化として、符号化制御部2により決定された符号化対象ブロックのイントラ予測パラメータが示す予測方向ベクトルと方向が最も近い予測方向ベクトルを特定し、その特定した予測方向代表ベクトルのインデックスを可変長符号化するとともに、符号化済みブロックのイントラ予測パラメータが示す予測方向ベクトルと予測方向代表ベクトルの差分を表すインデックスを可変長符号化する。
なお、可変長符号化部13は可変長符号化手段を構成している。 The variable
However, when the coding mode is the intra coding mode, the variable
The variable
図3はこの発明の実施の形態1による動画像符号化装置の処理内容(動画像符号化方法)を示すフローチャートである。 In the example of FIG. 1, a
FIG. 3 is a flowchart showing the processing contents (moving image coding method) of the moving image coding apparatus according to
可変長符号化部13は、構成要素の1つとして、イントラ予測パラメータ可変長符号化部13aを内蔵している。
イントラ予測パラメータ可変長符号化部13aのイントラ予測パラメータ予測値算出部21はブロック分割部1から出力された符号化対象ブロックに隣接している符号化済みブロックのイントラ予測パラメータから、符号化対象ブロックのイントラ予測パラメータの予測値を算出する処理を実施する。 FIG. 2 is a block diagram showing the inside of the variable
The variable
The intra prediction parameter prediction
エントロピー符号化部23はイントラ予測パラメータ二値化インデックス算出部22により算出されたイントラ予測パラメータ二値化インデックスを算術符号化などの可変長符号化を行って、イントラ予測パラメータ符号語を出力する処理を実施する。 The intra-prediction parameter binarization
The
図10において、可変長復号部31は動画像符号化装置により生成されたビットストリームを入力すると、そのビットストリームから圧縮データ、符号化モード、イントラ予測パラメータ(符号化モードがイントラ符号化モードである場合)、インター予測パラメータ(符号化モードがインター符号化モードである場合)、予測差分符号化パラメータ及び動きベクトル(符号化モードがインター符号化モードである場合)を可変長復号する処理を実施する。
ただし、可変長復号部31は符号化モードがイントラ符号化モードである場合、イントラ予測パラメータの可変長復号として、予測方向代表ベクトルのインデックスを可変長復号するとともに、復号済みブロック(図1の動画像符号化装置の「符号化済みブロック」に相当するブロック)のイントラ予測パラメータが示す予測方向ベクトルと予測方向代表ベクトルの差分を表すインデックスを可変長復号し、その予測方向代表ベクトルのインデックスと上記差分を表すインデックスから、そのイントラ予測パラメータを決定する処理を実施する。
なお、可変長復号部31は可変長復号手段を構成している。 FIG. 10 is a block diagram showing a moving picture decoding apparatus according to
In FIG. 10, when the variable
However, when the coding mode is the intra coding mode, the variable
The variable
なお、切換スイッチ33、イントラ予測部34及びイントラ予測用メモリ37から予測画像生成手段が構成されている。 The
The
加算部36は逆量子化・逆変換部32により算出された復号予測差分信号と、イントラ予測部34により生成されたイントラ予測画像、または、動き補償部35により生成されたインター予測画像とを加算して、図1のブロック分割部1から出力された符号化対象ブロックに相当する復号画像を算出する処理を実施する。 The
The
ループフィルタ部38は加算部36により算出された復号画像に対して、所定のフィルタリング処理を実施して、フィルタリング処理後の復号画像を出力する処理を実施する。
動き補償予測フレームメモリ39はフィルタリング処理後の復号画像を格納する記録媒体である。 The
The
The motion compensated
図12はこの発明の実施の形態1による動画像復号装置の処理内容(動画像復号方法)を示すフローチャートである。 In the example of FIG. 10, the variable
FIG. 12 is a flowchart showing the processing contents (moving image decoding method) of the moving image decoding apparatus according to
可変長復号部31には、構成要素の1つとして、イントラ予測パラメータ可変長復号部31aを内蔵している。
イントラ予測パラメータ可変長復号部31aのエントロピー復号部41はイントラ予測パラメータ符号語からイントラ予測パラメータ二値化インデックスを可変長復号する処理を実施する。
イントラ予測パラメータ予測値算出部42は復号対象ブロックに隣接している復号済みブロックのイントラ予測パラメータから、復号対象ブロックのイントラ予測パラメータの予測値を算出する処理を実施する。 FIG. 11 is a block diagram showing the inside of the variable
The variable
The
The intra prediction parameter prediction
この実施の形態1では、映像の各フレーム画像を入力画像として、近接フレーム間で動き補償予測を実施して、得られた予測差分信号に対して直交変換・量子化による圧縮処理を施し、その後、可変長符号化を行ってビットストリームを生成する動画像符号化装置と、その動画像符号化装置から出力されるビットストリームを復号する動画像復号装置について説明する。 Next, the operation will be described.
In the first embodiment, each frame image of a video is used as an input image, motion compensation prediction is performed between adjacent frames, and the obtained prediction difference signal is subjected to compression processing by orthogonal transformation / quantization, and then A moving picture coding apparatus that performs variable length coding to generate a bit stream and a moving picture decoding apparatus that decodes a bit stream output from the moving picture coding apparatus will be described.
一般的に、映像信号は、空間・時間的に信号の複雑さが局所的に変化する特性を有している。空間的に見ると、ある映像フレーム上では、例えば、空や壁などのような比較的広い画像領域中で均一な信号特性を有する絵柄もあれば、人物や細かいテクスチャを含む絵画など、小さい画像領域内で複雑なテクスチャパターンを有する絵柄も混在することがある。
時間的に見ても、空や壁は局所的に時間方向の絵柄の変化は小さいが、動く人物や物体は、その輪郭が時間的に剛体・非剛体の運動をするため、時間的な変化が大きい。 The moving picture coding apparatus in FIG. 1 performs intra-frame / inter-frame adaptive coding by dividing a video signal into blocks of various sizes in response to local changes in the spatial and temporal directions of the video signal. It is characterized by that.
In general, a video signal has a characteristic that the complexity of the signal changes locally in space and time. When viewed spatially, a small image, such as a picture with a uniform signal characteristic in a relatively wide image area such as the sky or a wall, or a picture containing a person or fine texture, on a video frame. A pattern having a complicated texture pattern in the region may be mixed.
Even when viewed temporally, the change in the pattern of the sky and the wall locally in the time direction is small, but because the outline of the moving person or object moves rigidly or non-rigidly in time, the temporal change Is big.
一方、時間的・空間的に変化の大きい画像信号パターンに対して、同一の予測パラメータを大きな画像領域に適用すると、予測の誤りが増えてしまうため、予測差分信号の符号量が増加してしまう。
したがって、時間的・空間的に変化が大きい領域では、同一の予測パラメータを適用して予測処理を行うブロックサイズを小さくして、予測に用いるパラメータのデータ量を増やし、予測差分信号の電力・エントロピーを低減する方が望ましい。 The encoding process generates a prediction difference difference signal with small signal power and entropy by temporal and spatial prediction, and reduces the overall code amount. If it can be applied uniformly, the code amount of the parameter can be reduced.
On the other hand, if the same prediction parameter is applied to a large image region with respect to an image signal pattern having a large temporal and spatial change, the number of prediction differential signals increases because prediction errors increase. .
Therefore, in a region where the temporal and spatial changes are large, the block size for performing the prediction process by applying the same prediction parameter is reduced, the amount of parameter data used for prediction is increased, and the power and entropy of the prediction difference signal are increased. It is desirable to reduce
ただし、各画素の諧調は、8ビットでもよいし、10ビットや12ビットなどの諧調でもよい。 The video signal format to be processed by the moving image encoding apparatus of FIG. 1 is a color video signal in an arbitrary color space such as a YUV signal composed of a luminance signal and two color difference signals, or an RGB signal output from a digital image sensor. In addition to the above, it is assumed that the video frame is an arbitrary video signal including a horizontal / vertical two-dimensional digital sample (pixel) sequence such as a monochrome image signal or an infrared image signal.
However, the gradation of each pixel may be 8 bits, or a gradation such as 10 bits or 12 bits.
また、映像信号の各フレームに対応する処理データ単位を「ピクチャ」と称する。
この実施の形態1では、「ピクチャ」は順次走査(プログレッシブスキャン)された映像フレーム信号として説明を行うが、映像信号がインタレース信号である場合、「ピクチャ」は映像フレームを構成する単位であるフィールド画像信号であってもよい。 In the following description, for convenience, unless otherwise specified, it is assumed that the video signal of the input image is a YUV signal, and the two color difference components U and V are subsampled with respect to the luminance component Y 4: 2: 0. The case of handling format signals will be described.
A processing data unit corresponding to each frame of the video signal is referred to as a “picture”.
In the first embodiment, “picture” is described as a video frame signal that is sequentially scanned (progressive scan). However, when the video signal is an interlaced signal, “picture” is a unit constituting a video frame. It may be a field image signal.
まず、符号化制御部2は、符号化対象となるピクチャ(カレントピクチャ)の符号化に用いる最大符号化ブロックのサイズと、最大符号化ブロックを階層分割する階層数の上限を決定する(図3のステップST1)。
最大符号化ブロックのサイズの決め方としては、例えば、入力画像の映像信号の解像度に応じて、すべてのピクチャに対して同一のサイズを定めてもよいし、入力画像の映像信号の局所的な動きの複雑さの違いをパラメータとして定量化して、動きの激しいピクチャには、小さいサイズを定める一方、動きが少ないピクチャには、大きいサイズを定めるようにしてもよい。
分割階層数の上限の決め方としては、例えば、入力画像の映像信号の動きが激しい場合には、階層数を深くして、より細かい動きが検出できるように設定し、動きが少ない場合には、階層数を抑えるように設定するなどの方法がある。 First, the processing contents of the moving picture encoding apparatus in FIG. 1 will be described.
First, the
As a method of determining the size of the maximum coding block, for example, the same size may be determined for all the pictures according to the resolution of the video signal of the input image, or the local motion of the video signal of the input image The size difference may be quantified as a parameter, and a small size may be determined for a picture with high motion, while a large size may be determined for a picture with little motion.
As an example of how to determine the upper limit of the number of division layers, for example, when the motion of the video signal of the input image is intense, set the number of layers to be deeper so that a finer motion can be detected. There are methods such as setting to suppress the number of layers.
また、符号化制御部2は、最大符号化ブロックサイズの画像領域毎に、先に定めた分割階層数の上限に至るまで、階層的に符号化ブロックサイズを有する符号化対象ブロックに分割して、各符号化対象ブロックに対する符号化モードを決定する(ステップST2)。 When the video signal of the input image is input, the
In addition, the
図4において、最大符号化ブロックは、「第0階層」と記されている輝度成分が(L0,M0)のサイズを有する符号化対象ブロックである。
最大符号化ブロックを出発点として、4分木構造で別途定める所定の深さまで、階層的に分割を行うことによって符号化対象ブロックを得るようにしている。
深さnにおいては、符号化対象ブロックはサイズ(Ln,Mn)の画像領域である。
ただし、LnとMnは、同じであってもよいし、異なっていてもよいが、図4では、Ln=Mnのケースを示している。 Here, FIG. 4 is an explanatory diagram showing an example in which the maximum coding block is hierarchically divided into a plurality of coding target blocks.
In FIG. 4, the maximum coding block is a coding target block whose luminance component indicated as “0th layer” has a size of (L 0 , M 0 ).
The encoding target block is obtained by hierarchically dividing the maximum encoding block as a starting point to a predetermined depth separately defined by a quadtree structure.
At the depth n, the encoding target block is an image area of size (L n , M n ).
However, L n and M n may be the same or different, but FIG. 4 shows the case of L n = M n .
4分木分割を行うため、常に、(Ln+1,Mn+1)=(Ln/2,Mn/2)が成立する。
なお、RGB信号など、全ての色成分が同一サンプル数を有するカラー映像信号(4:4:4フォーマット)では、全ての色成分のサイズが(Ln,Mn)になるが、4:2:0フォーマットを扱う場合、対応する色差成分の符号化ブロックサイズは(Ln/2,Mn/2)になる。 Hereinafter, the encoding block size determined by the
Since quadtree partitioning is performed, (L n + 1 , M n + 1 ) = (L n / 2, M n / 2) always holds.
Note that in a color video signal (4: 4: 4 format) in which all color components have the same number of samples, such as RGB signals, the size of all color components is (L n , M n ), but 4: 2. : When the 0 format is handled, the encoding block size of the corresponding color difference component is (L n / 2, M n / 2).
複数の色成分からなるカラー映像信号の場合、符号化モードm(Bn)は、色成分毎に、それぞれ個別のモードを用いるように構成されてもよいし、すべての色成分に対し共通のモードを用いるように構成されてもよい。以降、特に断らない限り、YUV信号、4:2:0フォーマットの符号化ブロックの輝度成分に対する符号化モードを指すものとして説明を行う。 Later, represents the encoding target block of the n hierarchy B n, the encoding modes selectable by the encoding target block B n as represented by m (B n).
In the case of a color video signal composed of a plurality of color components, the encoding mode m (B n ) may be configured to use an individual mode for each color component, or common to all color components. It may be configured to use a mode. Hereinafter, unless otherwise specified, description will be made assuming that it indicates a coding mode for a luminance component of a coding block of a YUV signal and 4: 2: 0 format.
以降、符号化対象ブロックBnに属するパーティションをPi n(iは、第n階層におけるパーティション番号)と表記する。
符号化対象ブロックBnのパーティション分割が、どのようになされているかは、符号化モードm(Bn)の中に情報として含まれる。
パーティションPi nは、すべて符号化モードm(Bn)に従って予測処理が行われるが、パーティションPi n毎に、個別の予測パラメータを選択することができる。 Furthermore, the encoding target block Bn is divided into one or a plurality of prediction processing units (partitions) by the
Hereinafter, a partition belonging to the encoding target block B n is denoted as P i n (i is a partition number in the nth layer).
How the partitioning of the encoding target block Bn is performed is included as information in the encoding mode m ( Bn ).
All partitions P i n are subjected to prediction processing according to the coding mode m (B n ), but individual prediction parameters can be selected for each partition P i n .
図5(a)の斜線部分は、分割後のパーティションの分布を示しており、図5(b)は階層分割によって符号化モードm(Bn)が割り当てられる状況を4分木グラフで示している。
図5(b)の□で囲まれているノードは、符号化モードm(Bn)が割り当てられたノード(符号化対象ブロック)である。
符号化制御部2における階層分割・符号化モード判定の詳細な処理は後述する。 For example, the
The shaded area in FIG. 5A shows the distribution of the partitions after the division, and FIG. 5B shows the situation where the encoding mode m (B n ) is assigned by the hierarchical division in a quadtree graph. Yes.
Nodes surrounded by □ in FIG. 5B are nodes (encoding target blocks) to which the encoding mode m (B n ) is assigned.
Detailed processing of layer division / coding mode determination in the
一方、符号化制御部2により決定された符号化モードm(Bn)がインター符号化モードである場合(m(Bn)∈INTERの場合)、ブロック分割部1から出力された符号化対象ブロックBnを動き補償予測部5に出力する。 Change-over
On the other hand, when the encoding mode m (B n ) determined by the
なお、画像復号装置がイントラ予測画像PINTRAi nと全く同じイントラ予測画像を生成する必要があるため、イントラ予測画像PINTRAi nの生成に用いられたイントラ予測パラメータは、符号化制御部2から可変長符号化部13に出力されて、ビットストリームに多重化される。
イントラ予測部4の処理内容の詳細は後述する。 The
Since the image decoding apparatus needs to generate exactly the same intra prediction image and the intra prediction image P INTRAi n, intra prediction parameters used for generating the intra prediction image P INTRAi n is a variable from the
Details of processing contents of the
なお、画像復号装置がインター予測画像PINTERi nと全く同じインター予測画像を生成する必要があるため、インター予測画像PINTERi nの生成に用いられたインター予測パラメータは、符号化制御部2から可変長符号化部13に出力されて、ビットストリームに多重化される。
また、動き補償予測部5により探索された動きベクトルも可変長符号化部13に出力されて、ビットストリームに多重化される。 The motion
Since the image decoding apparatus must generate an identical inter prediction image and the inter-predicted image P INTERi n, the inter prediction parameters used for generating the inter prediction image P INTERi n, the variable from the
In addition, the motion vector searched by the motion
また、変換・量子化部7は、その予測差分符号化パラメータを参照して、その変換係数を量子化し、量子化後の変換係数である圧縮データを逆量子化・逆変換部8及び可変長符号化部13に出力する(ステップST7)。 When receiving the prediction difference signal e i n from the
In addition, the transform /
また、逆量子化・逆変換部8は、その予測差分符号化パラメータを参照して、逆量子化後の圧縮データである変換係数に対する逆直交変換処理(例えば、逆DCT、逆KL変換など)を実施して、減算部6から出力された予測差分信号ei nに相当する局所復号予測差分信号を算出する(ステップST8)。 When receiving the compressed data from the transform /
The inverse quantization /
なお、加算部9は、その局所復号画像をループフィルタ部11に出力するとともに、その局所復号画像をイントラ予測用メモリ10に格納する。
この局所復号画像が、以降のイントラ予測用の画像信号になる。 Upon receiving the local decoded prediction difference signal from the inverse quantization /
The adding
This locally decoded image becomes an image signal for subsequent intra prediction.
なお、ループフィルタ部11によるフィルタリング処理は、入力される局所復号画像の最大符号化ブロックあるいは個々の符号化ブロック単位で行ってもよいし、1画面分のマクロブロックに相当する局所復号画像が入力された後に1画面分まとめて行ってもよい。 When the
The filtering process by the
可変長符号化部13の処理内容の詳細は後述する。 When the variable
Details of processing contents of the variable
図6は符号化対象ブロックBn内の各パーティションPi nが選択可能なイントラ予測パラメータ(イントラ予測モード)の一例を示す説明図である。
図6では、イントラ予測モードと、そのイントラ予測モードが示す予測方向ベクトルを示しており、図6の例では、選択可能なイントラ予測モードの個数が増えるに従って、予測方向ベクトル同士の相対角度が小さくなるように設計されている。 Next, the processing content of the
6 is an explanatory diagram showing an example of each partition P i n-selectable intra prediction parameters of the encoding target block B n (intra prediction mode).
6 shows the intra prediction mode and the prediction direction vector indicated by the intra prediction mode. In the example of FIG. 6, the relative angle between the prediction direction vectors decreases as the number of selectable intra prediction modes increases. Designed to be
図7はli n=mi n=4の場合のパーティションPi n内の画素の予測値を生成する際に用いる画素の一例を示す説明図である。
図7では、パーティションPi nに隣接している符号化済みの上パーティションの画素(2×li n+1)個と、左パーティションの画素(2×mi n)個を予測に用いる画素としているが、予測に用いる画素は、図7に示す画素より多くても少なくてもよい。
また、図7では、隣接している1行又は1列分の画素を予測に用いているが、2行又は2列、あるいは、それ以上の画素を予測に用いてもよい。 The size of the partition P i n is assumed to be l i n × m i n pixels.
FIG. 7 is an explanatory diagram illustrating an example of a pixel used when generating a predicted value of a pixel in the partition P i n when l i n = m i n = 4.
In Figure 7, the pixel (2 × l i n +1) pieces of coded upper partition adjacent to the partition P i n, as pixels used for predicting a pixel (2 × m i n) pieces of the left partition However, the number of pixels used for prediction may be more or less than the pixels shown in FIG.
In FIG. 7, pixels for one row or one column adjacent to each other are used for prediction, but pixels of two rows, two columns, or more may be used for prediction.
イントラ予測モードのインデックス値が2(平均値予測)以外の場合には、インデックス値が示す予測方向ベクトルυp=(dx,dy)に基づいて、パーティションPi n内の画素の予測値を生成する。
予測値を生成する画素(予測対象画素)のパーティションPi n内の相対座標(パーティションの左上画素を原点とする)を(x,y)とすると、予測に用いる参照画素の位置は、下記のLと隣接画素の交点になる。
When the index value of the intra prediction mode for the partition P i n is 2 (average value prediction), the average value of the adjacent pixels of the upper partition and the adjacent pixels of the left partition is predicted as the predicted value of the pixels in the partition P i n Generate an image.
If the index value of the intra prediction mode is other than 2 (average prediction), the prediction direction vector index value indicates upsilon p = (dx, dy) on the basis of, generating a prediction value of the pixel in the partition P i n To do.
Partitioning P i n in the relative coordinates of the pixels for generating the prediction value (prediction target pixel) a (an origin at the upper left pixel of the partition) as (x, y), the position of the reference pixels used for prediction, the following L is the intersection of adjacent pixels.
図7の例では、参照画素は整数画素位置にないので、参照画素に隣接する2画素の平均値を予測値とする。なお、隣接する2画素のみではなく、隣接する2画素以上の画素から補間画素を生成して予測値としてもよい。
同様の手順で、パーティションPi n内の輝度信号の全ての画素に対する予測画素を生成してイントラ予測画像PINTRAi nを出力する。
なお、イントラ予測画像PINTRAi nの生成に用いられたイントラ予測パラメータは、ビットストリームに多重化するために可変長符号化部13に出力される。 When the reference pixel is at the integer pixel position, the integer pixel is set as the prediction value of the prediction target pixel. When the reference pixel is not at the integer pixel position, an interpolation pixel generated from the integer pixel adjacent to the reference pixel is selected. Predicted value.
In the example of FIG. 7, since the reference pixel is not located at the integer pixel position, an average value of two pixels adjacent to the reference pixel is set as a predicted value. Note that an interpolation pixel may be generated not only from two adjacent pixels but also from two or more adjacent pixels, and used as a predicted value.
In a similar procedure, to generate a predicted pixel for all the pixels of the luminance signal in the partition P i n outputs an intra prediction image P INTRAi n.
Incidentally, the intra prediction parameters used for generating the intra prediction image P INTRAi n is outputted to the variable
可変長符号化部13は、イントラ予測パラメータを可変長符号化する際、周辺の符号化済みパーティションのイントラ予測パラメータに基づき、符号化対象のパーティションPi nのイントラ予測パラメータの予測値を算出し、その予測値を用いて予測符号化を行う。
即ち、可変長符号化部13の一部を構成しているイントラ予測パラメータ可変長符号化部13aのイントラ予測パラメータ予測値算出部21は、符号化済み周辺のパーティションのイントラ予測パラメータに基づき、符号化対象であるパーティションPi nのイントラ予測パラメータの予測値を算出する。
ここで、図8はパーティションPi nのイントラ予測パラメータの予測値の算出に用いる符号化済み周辺パーティションの一例を示す説明図である。
図8の例では、パーティションPi nの左(A)、上(B)、右上(C)、左上(D)のパーティションのイントラ予測パラメータを予測値の算出に用いている。 Next, the processing content of the variable
Variable
That is, the intra prediction parameter prediction
Here, FIG. 8 is an explanatory diagram showing an example of encoded peripheral partition used for calculating the predicted value of intra prediction parameters partitions P i n.
In the example of FIG. 8, the left partition P i n (A), above (B), upper right (C), are used intra prediction parameters partition the upper left (D) for the calculation of the predicted value.
図6において、17種類のイントラ予測モードは、平均値予測モードと16種類の方向性予測モードからなる。
図9は17種類のイントラ予測モードのインデックス値と平均値予測を除く、16種類の方向性予測モードの予測方向ベクトルの一例を示す説明図である。16種類の予測方向ベクトルの中から代表的な方向を示す予測方向代表ベクトルを予め決めおくものとする。
以下の説明では、図9に示す“0”から“8”の9方向の予測方向ベクトルを予測方向代表ベクトルとして予め決めた場合を例に説明する。 The process in which the intra prediction parameter prediction
In FIG. 6, 17 types of intra prediction modes include an average value prediction mode and 16 types of direction prediction modes.
FIG. 9 is an explanatory diagram showing an example of prediction direction vectors in 16 types of directional prediction modes excluding index values and average value predictions in 17 types of intra prediction modes. It is assumed that a prediction direction representative vector indicating a representative direction out of 16 types of prediction direction vectors is determined in advance.
In the following description, a case where nine prediction direction vectors “0” to “8” shown in FIG. 9 are predetermined as prediction direction representative vectors will be described as an example.
ただし、方向性予測モードの予測方向代表インデックスは、その方向性予測モードが示す予測方向ベクトルに対する相対角度が最も小さい予測方向代表ベクトルのインデックスとする。
即ち、方向性予測モードが示す予測方向ベクトルと方向が近い予測方向代表ベクトルのインデックス値である。なお、平均値予測モードの予測方向代表インデックスは、自身(平均値予測モード)のインデックス値とする。
図9は17種類のイントラ予測モードの予測方向代表インデックスを示している。さらに、同じ予測方向代表インデックスを有するイントラ予測モードインデックスに対して、予測方向差分インデックスを割り当てている。 The intra prediction parameter prediction
However, the prediction direction representative index of the directionality prediction mode is an index of the prediction direction representative vector having the smallest relative angle with respect to the prediction direction vector indicated by the directionality prediction mode.
That is, the index value of the prediction direction representative vector whose direction is close to that of the prediction direction vector indicated by the directionality prediction mode. Note that the prediction direction representative index in the average value prediction mode is the index value of itself (average value prediction mode).
FIG. 9 shows prediction direction representative indexes of 17 types of intra prediction modes. Furthermore, a prediction direction difference index is assigned to an intra prediction mode index having the same prediction direction representative index.
例えば、予測値の算出に用いる周辺パーティションがパーティションPi nの左(A)、上(B)、右上(C)、左上(D)のパーティションである場合、パーティションA,B,C,Dの予測方向代表インデックスをそれぞれmA,mB,mC,mDとしたときに、mA,mB,mC,mDの最頻値や最小値、メディアンなどの統計値の中から予め決められた統計値を予測値pmpとする。あるいは、周囲のパーティションの予測方向ベクトルの向きに応じて、例えば、パーティションCの予測方向ベクトルの向きが左斜め下の場合(図9の例では、イントラ予測モードインデックスが8、10、16の場合)、エッジの連続性から考えて、パーティションPi nの予測方向ベクトルの向きも左斜め下になる確率が高いことから、予測方向代表ベクトルの向きが左斜め下を表す予測方向代表インデックス(図9の例では8)を、パーティションPi nの予測値pmpとする。あるいは、A、B、C、Dのパーティションの中から予め決められた1つのパーティションの予測方向代表インデックスを予測値pmpとしてもよい。あるいは、周辺パーティションの予測方向代表インデックスを用いずに、予め決められた予測方向代表インデックス(例えば平均値予測モードのインデックス)を予測値pmpとしてもよい。
そして、算出した予測値pmpをイントラ予測パラメータ二値化インデックス算出部22に出力する。 Then, based on the prediction direction representative index of the intra prediction modes of encoded peripheral partition, a description will be given of a process for calculating the predicted value of the intra prediction parameters partitions P i n to be encoded.
For example, the left peripheral partition partition P i n used for calculating the predicted value (A), in the case where a partition above (B), upper right (C), top left (D), the partition A, B, C, D When the prediction direction representative index is set to m A , m B , m C , and m D , respectively, statistics values such as mode values, minimum values, and medians of m A , m B , m C , and m D are preliminarily stored. The determined statistical value is set as a predicted value pm p . Alternatively, depending on the direction of the prediction direction vector of the surrounding partition, for example, when the direction of the prediction direction vector of the partition C is diagonally lower left (in the example of FIG. 9, the intra prediction mode index is 8, 10, 16) ), given from the continuity of the edge, since the probability that also the orientation of the prediction direction vector of the partition P i n becomes lower left oblique is high, the prediction direction representative index (drawing direction of the prediction direction representative vectors represent a lower left oblique 8) in the example of 9, as the predicted value pm p partitions P i n. Alternatively, a prediction direction representative index of one partition determined in advance from among the A, B, C, and D partitions may be used as the predicted value pm p . Alternatively, a prediction direction representative index (for example, an index in the average value prediction mode) determined in advance may be used as the prediction value pm p without using the prediction direction representative index of the peripheral partition.
Then, the calculated prediction value pm p is output to the intra prediction parameter binarization
以下、イントラ予測パラメータ二値化インデックスの算出方法について説明する。 Intra prediction parameters binarization
Hereinafter, a method of calculating the intra prediction parameter binarization index will be described.
ただし、mは予測方向代表インデックスの個数であり、図9の例では、m=9,n=3である。 Let rm p be the prediction direction representative index of the intra prediction mode mp.
However, m is the number of prediction direction representative indexes, and m = 9 and n = 3 in the example of FIG.
ただし、lは同じ予測方向代表インデックスを有するイントラ予測モードの個数であり、図9の例では、イントラ予測モードが平均値予測の場合には、l=1,k=0、イントラ予測モードが平均値予測以外の場合には、l=2,k=1である。 Next, the prediction direction difference index of the intra prediction mode m p is set to dr p , and the processing based on the following expression is further performed on the intra prediction parameter binarization index dm p .
However, l is the number of intra prediction modes having the same prediction direction representative index. In the example of FIG. 9, when the intra prediction mode is average value prediction, l = 1, k = 0, and the intra prediction mode is average. In cases other than value prediction, l = 2 and k = 1.
イントラ予測モードの予測方向代表インデックスrmpと予測値pmpが一致している場合、イントラ予測パラメータ二値化インデックスdmpの2~(k+1)ビットが、予測方向差分インデックス値を表すビットになる。
一方、イントラ予測モードの予測方向代表インデックスrmpと予測値pmpが一致していない場合、イントラ予測パラメータ二値化インデックスdmpの2~(n+1)ビットが、予測方向代表インデックス値を表すビットになり、(n+2)~(n+k+1)ビットが、予測方向差分インデックス値を表すビットになる。
以上の処理により算出されたイントラ予測パラメータ二値化インデックスdmpは、エントロピー符号化部23に出力される。 In the intra prediction parameter binarization index dm p obtained by the above calculation method, the first bit is a flag bit indicating whether the prediction direction representative index rm p of the intra prediction mode matches the prediction value pm p ( In the above calculation formula, “0” is assigned if they match, and “1” is assigned if they do not match).
When the prediction direction representative index rm p and the predicted value pm p intra prediction modes match, 2 ~ (k + 1) bits of the intra prediction parameters binarization index dm p becomes the bits representing the prediction direction difference index value .
On the other hand, when the prediction direction representative index rm p in the intra prediction mode and the prediction value pm p do not match, 2 to (n + 1) bits of the intra prediction parameter binarization index dm p are bits representing the prediction direction representative index value. Thus, (n + 2) to (n + k + 1) bits are bits representing the prediction direction difference index value.
The intra prediction parameter binarization index dm p calculated by the above processing is output to the
その符号化結果であるイントラ予測パラメータ符号語は、可変長符号化部13のビットストリーム多重化部(図示せず)でビットストリームに多重化される。 The
The intra prediction parameter codeword that is the encoding result is multiplexed into a bitstream by a bitstream multiplexing unit (not shown) of the variable
可変長復号部31は、図1の動画像符号化装置により生成されたビットストリームを入力すると、そのビットストリームに対する可変長復号処理を実施して(図12のステップST21)、1フレーム以上のピクチャから構成されるシーケンス単位、あるいは、ピクチャ単位にフレームサイズの情報を復号する。 Next, the processing content of the moving picture decoding apparatus of FIG. 10 is demonstrated concretely.
When the variable
例えば、最大符号化ブロックサイズが映像信号の解像度に応じて決められた場合には、復号したフレームサイズ情報に基づいて、動画像符号化装置と同様の手順で最大符号化ブロックサイズを決定する。
最大符号化ブロックサイズ及び分割階層数上限が、動画像符号化装置側でビットストリームに多重化された場合には、ビットストリームから復号した値を用いる。
動画像符号化装置は、図4で示されるように、最大符号化ブロックを出発点に階層的に複数の符号化対象ブロックに分割して得られる符号化対象ブロック単位に符号化モードや変換・量子化して得られる圧縮データをビットストリームに多重化する。
当該ビットストリームを受け取った可変長復号部31は、決定された最大符号化ブロック単位に符号化モードに含まれる最大符号化ブロックの分割状態を復号する。復号された分割状態に基づき、階層的に復号対象ブロック(図1の動画像符号化装置の「符号化対象ブロック」に相当するブロック)を特定する(ステップST23)。 That is, the variable
For example, when the maximum encoding block size is determined according to the resolution of the video signal, the maximum encoding block size is determined based on the decoded frame size information in the same procedure as the moving image encoding apparatus.
When the maximum encoding block size and the upper limit of the number of division layers are multiplexed on the bit stream on the moving image encoding device side, values decoded from the bit stream are used.
As shown in FIG. 4, the moving image encoding apparatus is configured to encode an encoding mode and a conversion / conversion in units of encoding target blocks obtained by hierarchically dividing a maximum encoding block into a plurality of encoding target blocks starting from a starting point. The compressed data obtained by quantization is multiplexed into a bit stream.
The variable
イントラ予測パラメータの復号は、動画像符号化装置側と同じ手順で周辺の復号済みパーティションのイントラ予測パラメータに基づき、復号対象であるパーティションPi nのイントラ予測パラメータの予測値を算出し、その予測値を用いて復号する。 When the encoding mode assigned to the decoding target block (encoding target block) is the intra encoding mode, the variable
Decoding the intra prediction parameters is based on the intra prediction parameters decoded partition near the same procedure as the video encoding apparatus calculates a predicted value of intra prediction parameters partitions P i n is decoded, the prediction Decode using the value.
イントラ予測パラメータ予測値算出部42は、動画像符号化装置のイントラ予測パラメータ予測値算出部21と同じ手順で、復号対象ブロックに隣接している復号済みブロックのイントラ予測パラメータから、復号対象ブロックのイントラ予測パラメータの予測値を算出する。 That is, the
The intra prediction parameter prediction
以下、イントラ予測パラメータの算出方法を説明する。 The intra prediction parameter index calculation unit 43 calculates an intra prediction parameter from the intra prediction parameter binarization index variable-length decoded by the
Hereinafter, a method for calculating the intra prediction parameter will be described.
イントラ予測パラメータ二値化インデックスをdmpとする。
イントラ予測パラメータ二値化インデックスdmpの1ビット目が“0”の場合、予測値pmpを予測方向代表インデックス値rmpとする。
イントラ予測パラメータ二値化インデックスdmpの1ビット目が“1”の場合、続いて、2~(k+1)ビットを復号し、2~(n+1)ビットを復号した値RMpに対して、下式により予測方向代表インデックス値rmpを算出する。
The intra prediction parameter index calculation unit 43 calculates a prediction direction representative index and a prediction direction difference index in order to calculate an intra prediction parameter index.
Let intra prediction parameter binarization index be dm p .
When the first bit of the intra prediction parameter binarization index dm p is “0”, the prediction value pm p is set as the prediction direction representative index value rm p .
When the first bit of the intra-prediction parameter binarization index dm p is “1”, 2 to (k + 1) bits are subsequently decoded, and the value RM p obtained by decoding 2 to (n + 1) bits is The prediction direction representative index value rm p is calculated by the equation.
可変長復号部31は、符号化モードに割り当てられている符号化モードがインター符号化モードの場合、復号対象ブロック(符号化対象ブロック)に含まれており、予測処理単位となる1つ以上パーティション毎にインター予測パラメータを復号する。
可変長復号部31は、予測処理単位となるパーティションを、更に予測差分符号化パラメータに含まれる変換ブロックサイズの情報に基づき、変換処理単位となる1つないし複数のパーティションに分割され、変換処理単位となるパーティション毎に圧縮データ(変換・量子化後の変換係数)を復号する(ステップST24)。 Also in the video decoding device, the intra prediction parameter index is decoded based on the prediction direction representative index and the prediction direction difference index, similarly to the video encoding device.
When the encoding mode assigned to the encoding mode is the inter encoding mode, the variable
The variable
一方、可変長復号部31により可変長復号された符号化モードm(Bn)がインター符号化モードであれば(m(Bn)∈INTERの場合)、可変長復号部31により可変長復号されたインター予測パラメータ及び動きベクトルを動き補償部35に出力する。 If the encoding mode m (B n ) variable-length decoded by the variable-
On the other hand, (the case of m (B n) ∈INTER) variable length decoded coding mode m (B n) is if the inter coding mode by the variable
この復号画像が、以降のイントラ予測用の画像信号になる。
This decoded image becomes an image signal for subsequent intra prediction.
この復号画像が、動き補償予測用の参照画像となり、また、再生画像となる。 When the processing of steps ST23 to ST29 for all the decoding target blocks Bn is completed (step ST30), the
This decoded image becomes a reference image for motion compensation prediction and also becomes a reproduced image.
上記実施の形態1では、動画像符号化装置のイントラ予測部4が、映像信号における輝度信号と色差信号を同様に取り扱い、輝度信号の符号化対象ブロックに対するイントラ予測処理と、色差信号の符号化対象ブロックに対するイントラ予測処理とを別個独立に実施している。
このため、可変長符号化部13は、輝度信号の符号化対象ブロックに対するイントラ予測処理を実施する際に用いているイントラ予測パラメータと、色差信号の符号化対象ブロックに対するイントラ予測処理を実施する際に用いているイントラ予測パラメータとを個別に可変長符号化してビットストリームに多重化するようにしている。
この場合、例えば、輝度信号の符号化対象ブロックと色差信号の符号化対象ブロックとの特徴が近似しており、双方の符号化対象ブロックに対するイントラ予測処理を実施する際に用いているイントラ予測パラメータがほぼ同じであれば、ビットストリームに多重化しているイントラ予測パラメータが冗長的となる。
In the first embodiment, the
For this reason, the variable
In this case, for example, the characteristics of the luminance signal encoding target block and the color difference signal encoding target block are approximate, and the intra prediction parameters used when performing the intra prediction processing on both of the encoding target blocks. Are substantially the same, the intra prediction parameters multiplexed in the bit stream are redundant.
図13は輝度信号及び色差信号のパーティションPi nの一例を示す説明図である。
動画像符号化装置のイントラ予測部4は、図13(a)に示すように、パーティションPi nの輝度信号(Y)にエッジがある場合、色差信号(Cb,Cr)に対しても同様のエッジが存在することが多いという特徴を利用して、輝度信号で適用されたイントラ予測パラメータを色差信号のイントラ予測パラメータとしてそのまま適用し、イントラ予測画像を生成する。
ただし、図13(b)に示すように、パーティションPi nの輝度信号(Y)にエッジがあっても、グレースケールのエッジである場合、色差信号(Cb,Cr)にはエッジがないこともある。
このような場合には、輝度信号のイントラ予測パラメータを適用せずに、平均値予測を適用して、イントラ予測画像を生成するようにする。 Specifically, it is as follows.
Figure 13 is an explanatory diagram showing an example of the partition P i n the luminance signal and color difference signals.
However, as shown in FIG. 13 (b), even if there is an edge in the luminance signal of the partition P i n (Y), there is no edge in the case of the edge of the gray scale, color difference signals (Cb, Cr) There is also.
In such a case, the intra prediction image is generated by applying the average value prediction without applying the intra prediction parameter of the luminance signal.
このような場合には、エッジの境界がぼけていたり、切れていたりする領域の画素で予測残差が大きくなって、予測残差に係る符号量が増えるおそれがある。
そこで、予測残差に係る符号量が増える状況の発生を避けるため、図14に示すように、輝度信号の符号化対象ブロックに対するイントラ予測処理を実施する際に用いているイントラ予測パラメータと同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施することで予測画像を生成したのち、エッジをぼかすように、その予測画像に対して、平滑化フィルタをかけるようにする。
この場合、フィルタ処理後の予測画像が、色差信号の予測画像となる。 Further, as shown in FIG. 13 (c), the luminance signal of the partition P i n (Y) even if there is an edge, the color-difference signals (Cb, Cr), or have blurred boundary edge, or has expired Sometimes.
In such a case, there is a possibility that the prediction residual becomes large in the pixels in the region where the edge boundary is blurred or broken, and the amount of code related to the prediction residual increases.
Therefore, in order to avoid the occurrence of a situation in which the amount of code related to the prediction residual increases, as shown in FIG. 14, the same intra prediction parameters as the intra prediction parameters used when the intra prediction process is performed on the coding target block of the luminance signal. A prediction image is generated by performing intra prediction processing on a coding target block of a color difference signal using a prediction parameter, and then a smoothing filter is applied to the prediction image so as to blur an edge. .
In this case, the predicted image after the filter process is a predicted image of the color difference signal.
即ち、可変長符号化部13は、色差信号で適用されたイントラ予測パラメータ自体は可変長符号化せずに、そのイントラ予測パラメータの代わりに、輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施しているか、平均値予測を適用しているかを示す1ビットのフラグを算術符号化などによりエントロピー符号化する。
これにより、色差信号で適用されたイントラ予測パラメータとして、1ビットのフラグがビットストリームに多重化される。
なお、必要に応じて、予測画像に対して平滑化フィルタをかける場合、平滑化フィルタをかけているか否かを示す1ビットのフラグを算術符号化などによりエントロピー符号化する。 The variable-
That is, the variable
As a result, a 1-bit flag is multiplexed into the bitstream as an intra prediction parameter applied in the color difference signal.
If necessary, when a smoothing filter is applied to a predicted image, a 1-bit flag indicating whether or not the smoothing filter is applied is entropy-encoded by arithmetic encoding or the like.
また、方向性予測モードを適用して生成された予測画像に対して平滑化フィルタをかけた画像を色差信号の予測画像としてもよい。 Here, the
An image obtained by applying a smoothing filter to a predicted image generated by applying the directionality prediction mode may be used as a predicted image of a color difference signal.
イントラ予測部34は、可変長復号部31により可変長復号されたフラグが、輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施している旨を示している場合、図1のイントラ予測部4と同様に、輝度信号と同じイントラ予測パラメータを用いて、色差信号の復号対象ブロック(符号化対象ブロック)に対するイントラ予測処理を実施して色差信号の予測画像を生成する。
一方、そのフラグが、平均値予測を適用している旨を示している場合(輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施していない旨を示している場合)、図1のイントラ予測部4と同様に、平均値予測を適用して、色差信号の復号対象ブロックに対するイントラ予測処理を実施して色差信号の予測画像を生成する。
また、そのフラグが、水平予測(あるいは、垂直予測)を適用している旨を示している場合、水平予測(あるいは、垂直予測)を適用して、色差信号の復号対象ブロックに対するイントラ予測処理を実施して色差信号の予測画像を生成する。 The variable
The
On the other hand, when the flag indicates that the average value prediction is applied (the intra prediction process is not performed on the encoding target block of the color difference signal using the same intra prediction parameter as the luminance signal). In the same manner as in the
In addition, when the flag indicates that horizontal prediction (or vertical prediction) is applied, horizontal prediction (or vertical prediction) is applied to perform intra prediction processing on the decoding target block of the color difference signal. It implements and produces | generates the estimated image of a color difference signal.
この場合、フィルタ処理後の予測画像が、色差信号の予測画像となる。 When the 1-bit flag indicating whether or not the smoothing filter is applied is variable-length decoded by the variable
In this case, the predicted image after the filter process is a predicted image of the color difference signal.
Claims (6)
- 輝度信号及び色差信号からなる入力画像を予測処理単位のブロックに分割して、予測処理単位のブロックである符号化対象ブロックを出力するブロック分割手段と、上記ブロック分割手段から出力される符号化対象ブロックに対するイントラ予測処理を実施する際に用いるイントラ予測パラメータを決定する符号化制御手段と、上記符号化制御手段により決定されたイントラ予測パラメータを用いて、上記ブロック分割手段から出力された符号化対象ブロックに対するイントラ予測処理を実施して、輝度信号及び色差信号の予測画像を生成する予測画像生成手段と、上記予測画像生成手段により生成された予測画像と上記ブロック分割手段から出力された符号化対象ブロックの差分画像を量子化し、上記差分画像の量子化係数を出力する量子化手段と、上記量子化手段から出力された量子化係数及び上記符号化制御手段により決定されたイントラ予測パラメータを可変長符号化してビットストリームを生成する可変長符号化手段とを備え、
上記予測画像生成手段は、色差信号の予測画像を生成する際、輝度信号の符号化対象ブロックに対するイントラ予測処理を実施する際に用いるイントラ予測パラメータと同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施し、あるいは、平均値予測を適用して、色差信号の符号化対象ブロックに対するイントラ予測処理を実施し、
上記可変長符号化手段は、色差信号の符号化対象ブロックに対するイントラ予測処理を実施する際に用いるイントラ予測パラメータとして、上記予測画像生成手段が輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施しているか否かを示すフラグを可変長符号化することを特徴とする動画像符号化装置。 A block dividing unit that divides an input image made up of a luminance signal and a color difference signal into blocks of prediction processing units and outputs an encoding target block that is a block of prediction processing units, and an encoding target output from the block dividing unit An encoding control unit that determines an intra prediction parameter used when performing an intra prediction process on a block, and an encoding target output from the block dividing unit using the intra prediction parameter determined by the encoding control unit Prediction image generating means for performing intra prediction processing on a block to generate a prediction image of a luminance signal and a color difference signal, a prediction image generated by the prediction image generating means, and an encoding target output from the block dividing means Quantize the difference image of the block and output the quantization coefficient of the difference image Comprising means and, the variable length coding means for generating a bit stream by variable length coding to the intra prediction parameters determined by the quantization coefficient and the coding control unit output from the quantization means,
The predicted image generation means uses the same intra prediction parameters as the intra prediction parameters used when performing the intra prediction processing on the coding target block of the luminance signal when generating the predicted image of the color difference signal. The intra prediction process for the encoding target block is performed, or the average prediction is applied to perform the intra prediction process for the encoding target block of the color difference signal,
The variable length coding means uses the same intra prediction parameter as the luminance signal as the intra prediction parameter used when the intra prediction process for the encoding target block of the color difference signal is performed. A moving picture encoding apparatus characterized in that a variable length encoding is performed on a flag indicating whether or not intra prediction processing is being performed on an encoding target block. - 予測画像生成手段は、色差信号の符号化対象ブロックに対するイントラ予測処理を実施して、色差信号の予測画像を生成してから、上記予測画像に対して平滑化フィルタをかけることを特徴とする請求項1記載の動画像符号化装置。 The predicted image generation means performs intra prediction processing on the encoding target block of the color difference signal to generate a predicted image of the color difference signal, and then applies a smoothing filter to the predicted image. Item 4. A moving image encoding apparatus according to Item 1.
- ビットストリームから量子化係数及びイントラ予測パラメータを可変長復号する可変長復号手段と、上記可変長復号手段により可変長復号された量子化係数を逆量子化する逆量子化手段と、上記可変長復号手段により可変長復号されたイントラ予測パラメータを用いて、復号対象ブロックに対するイントラ予測処理を実施して、輝度信号及び色差信号の予測画像を生成する予測画像生成手段と、上記予測画像生成手段により生成された予測画像と上記逆量子化手段の逆量子化結果が示す差分画像を加算して復号画像を得る画像加算手段とを備え、
上記可変長復号手段は、上記ビットストリームからフラグを可変長復号し、
上記予測画像生成手段は、上記可変長復号手段により可変長復号されたフラグが、輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施している旨を示している場合、輝度信号と同じイントラ予測パラメータを用いて、色差信号の復号対象ブロックに対するイントラ予測処理を実施して色差信号の予測画像を生成し、上記フラグが、輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施していない旨を示している場合、平均値予測を適用して、色差信号の復号対象ブロックに対するイントラ予測処理を実施して色差信号の予測画像を生成することを特徴とする動画像復号装置。 Variable-length decoding means for variable-length decoding quantization coefficients and intra prediction parameters from the bitstream, dequantization means for inverse-quantizing the quantized coefficients variable-length decoded by the variable-length decoding means, and the variable-length decoding A prediction image generating unit that generates a prediction image of a luminance signal and a chrominance signal by performing an intra prediction process on a decoding target block using the intra prediction parameter variable-length decoded by the unit, and generated by the prediction image generating unit Image addition means for adding the predicted image and the difference image indicated by the inverse quantization result of the inverse quantization means to obtain a decoded image,
The variable length decoding means variable length decodes a flag from the bitstream,
The prediction image generation means indicates that the flag variable-length decoded by the variable-length decoding means is performing intra prediction processing on the encoding target block of the color difference signal using the same intra prediction parameters as the luminance signal. If the same intra prediction parameter as that of the luminance signal is used, intra prediction processing is performed on the decoding target block of the chrominance signal to generate a prediction image of the chrominance signal, and the flag indicates the same intra prediction parameter as that of the luminance signal. Is used to indicate that the intra prediction process for the encoding target block of the color difference signal is not performed, the average prediction is applied, the intra prediction process for the decoding target block of the color difference signal is performed, and the color difference is determined. A moving picture decoding apparatus that generates a predicted picture of a signal. - 予測画像生成手段は、色差信号の復号対象ブロックに対するイントラ予測処理を実施して、色差信号の予測画像を生成してから、上記予測画像に対して平滑化フィルタをかけることを特徴とする請求項3記載の動画像復号装置。 The predicted image generation means performs intra prediction processing on a decoding target block of a color difference signal to generate a predicted image of the color difference signal, and then applies a smoothing filter to the predicted image. 3. The moving picture decoding apparatus according to 3.
- ブロック分割手段が、輝度信号及び色差信号からなる入力画像を予測処理単位のブロックに分割して、予測処理単位のブロックである符号化対象ブロックを出力するブロック分割処理ステップと、符号化制御手段が、上記ブロック分割処理ステップによって出力される符号化対象ブロックに対するイントラ予測処理を実施する際に用いるイントラ予測パラメータを決定する符号化制御処理ステップと、予測画像生成手段が、上記符号化制御処理ステップで決定されたイントラ予測パラメータを用いて、上記ブロック分割処理ステップによって出力された符号化対象ブロックに対するイントラ予測処理を実施して、輝度信号及び色差信号の予測画像を生成する予測画像生成処理ステップと、量子化手段が、上記予測画像生成処理ステップで生成された予測画像と上記ブロック分割処理ステップによって出力された符号化対象ブロックの差分画像を量子化し、上記差分画像の量子化係数を出力する量子化処理ステップと、可変長符号化手段が、上記量子化処理ステップによって出力された量子化係数及び上記符号化制御処理ステップで決定されたイントラ予測パラメータを可変長符号化してビットストリームを生成する可変長符号化処理ステップとを備え、
上記可変長符号化手段が、色差信号の予測画像を生成する際、輝度信号の符号化対象ブロックに対するイントラ予測処理を実施する際に用いるイントラ予測パラメータと同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施し、あるいは、平均値予測を適用して、色差信号の符号化対象ブロックに対するイントラ予測処理を実施し、
上記可変長符号化手段が、色差信号の符号化対象ブロックに対するイントラ予測処理を実施する際に用いるイントラ予測パラメータとして、上記可変長符号化手段が輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施しているか否かを示すフラグを可変長符号化することを特徴とする動画像符号化方法。 A block dividing unit that divides an input image composed of a luminance signal and a color difference signal into blocks of a prediction processing unit and outputs an encoding target block that is a block of the prediction processing unit; and an encoding control unit An encoding control processing step for determining an intra prediction parameter used when performing an intra prediction process on the encoding target block output by the block division processing step, and a prediction image generating means in the encoding control processing step. A predicted image generation processing step of performing intra prediction processing on the encoding target block output by the block division processing step using the determined intra prediction parameter, and generating a prediction image of a luminance signal and a color difference signal; Quantization means is generated in the predicted image generation processing step A quantization processing step for quantizing a difference image between the prediction target image and the encoding target block output by the block division processing step, and outputting a quantization coefficient of the difference image; and a variable length encoding means, A variable-length encoding processing step for generating a bitstream by variable-length encoding the quantization coefficient output in the encoding processing step and the intra prediction parameter determined in the encoding control processing step,
When the variable-length encoding unit generates a prediction image of a color difference signal, it uses the same intra prediction parameter as the intra prediction parameter used when performing the intra prediction processing on the encoding target block of the luminance signal, Perform intra prediction processing for the block to be encoded, or apply average prediction to perform intra prediction processing for the block to be encoded of the color difference signal,
The variable length encoding means uses the same intra prediction parameters as the luminance signal as the intra prediction parameters used when the variable length encoding means performs the intra prediction processing for the encoding target block of the color difference signals, and the color difference signal A moving picture coding method characterized in that a variable length coding is performed on a flag indicating whether or not an intra prediction process is performed on a current block to be coded. - 可変長復号手段が、ビットストリームから量子化係数及びイントラ予測パラメータを可変長復号する可変長復号処理ステップと、逆量子化手段が、上記可変長復号処理ステップで可変長復号された量子化係数を逆量子化する逆量子化処理ステップと、予測画像生成手段が、上記可変長復号処理ステップで可変長復号されたイントラ予測パラメータを用いて、復号対象ブロックに対するイントラ予測処理を実施して、輝度信号及び色差信号の予測画像を生成する予測画像生成処理ステップと、画像加算手段が、上記予測画像生成処理ステップで生成された予測画像と上記逆量子化処理ステップでの逆量子化結果が示す差分画像を加算して復号画像を得る画像加算処理ステップとを備え、
上記可変長復号手段が、上記ビットストリームからフラグを可変長復号し、
上記予測画像生成手段が、上記フラグが、輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施している旨を示している場合、輝度信号と同じイントラ予測パラメータを用いて、色差信号の復号対象ブロックに対するイントラ予測処理を実施して色差信号の予測画像を生成し、上記フラグが、輝度信号と同じイントラ予測パラメータを用いて、色差信号の符号化対象ブロックに対するイントラ予測処理を実施していない旨を示している場合、平均値予測を適用して、色差信号の復号対象ブロックに対するイントラ予測処理を実施して色差信号の予測画像を生成することを特徴とする動画像復号方法。 The variable length decoding means variable length decodes the quantization coefficient and the intra prediction parameter from the bit stream, and the inverse quantization means converts the quantized coefficient variable length decoded in the variable length decoding process step. The inverse quantization processing step for performing inverse quantization, and the prediction image generation unit performs intra prediction processing on the decoding target block using the intra prediction parameter that has been subjected to variable length decoding in the variable length decoding processing step. And a prediction image generation processing step for generating a prediction image of the color difference signal, and a difference image indicated by the image addition means, the prediction image generated in the prediction image generation processing step and the inverse quantization result in the inverse quantization processing step. And an image addition processing step for obtaining a decoded image by adding
The variable length decoding means variable length decodes a flag from the bitstream;
When the prediction image generation means indicates that the flag is performing intra prediction processing on the encoding target block of the color difference signal using the same intra prediction parameter as the luminance signal, the same intra as the luminance signal. Using the prediction parameter, intra prediction processing is performed on the decoding target block of the chrominance signal to generate a prediction image of the chrominance signal, and the flag is the target of encoding the chrominance signal using the same intra prediction parameter as the luminance signal. When the intra prediction process is not performed on the block, the average value prediction is applied, and the intra prediction process is performed on the decoding target block of the chrominance signal to generate a predicted image of the chrominance signal. A video decoding method.
Priority Applications (18)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020147009217A KR20140049095A (en) | 2010-07-15 | 2011-07-07 | Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method |
EP11806461.7A EP2595386A4 (en) | 2010-07-15 | 2011-07-07 | Video encoding device, video decoding device, video encoding method, and video decoding method |
CA2805328A CA2805328A1 (en) | 2010-07-15 | 2011-07-07 | Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method |
SG2013002779A SG187062A1 (en) | 2010-07-15 | 2011-07-07 | Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method |
KR1020137003840A KR20130069726A (en) | 2010-07-15 | 2011-07-07 | Video encoding device video decoding device video encoding method and video decoding method |
JP2012524443A JP5656998B2 (en) | 2010-07-15 | 2011-07-07 | Moving picture decoding apparatus and moving picture decoding method |
KR1020147022240A KR101529452B1 (en) | 2010-07-15 | 2011-07-07 | Moving image decoding device, and moving image decoding method |
KR1020147035797A KR101562158B1 (en) | 2010-07-15 | 2011-07-07 | Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method |
MX2013000525A MX2013000525A (en) | 2010-07-15 | 2011-07-07 | Video encoding device, video decoding device, video encoding method, and video decoding method. |
BR112013000516-5A BR112013000516B1 (en) | 2010-07-15 | 2011-07-07 | DEVICE AND METHOD OF MOTION IMAGE ENCODING, AND, DEVICE AND METHOD OF MOTION IMAGE DECODING |
RU2013106507/08A RU2533649C1 (en) | 2010-07-15 | 2011-07-07 | Moving image encoding device, moving image decoding device, moving image encoding method and moving image decoding method |
KR1020157012081A KR20150059797A (en) | 2010-07-15 | 2011-07-07 | Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method |
US13/810,072 US9462271B2 (en) | 2010-07-15 | 2011-07-07 | Moving image encoding device, moving image decoding device, moving image coding method, and moving image decoding method |
CN201180034748.8A CN103004201B (en) | 2010-07-15 | 2011-07-07 | Dynamic image encoding device, moving image decoding apparatus, dynamic image encoding method and dynamic image decoding method |
TW100124551A TWI533676B (en) | 2010-07-15 | 2011-07-12 | Moving image encoding device, moving image decoding device, moving image encoding method, moving image decoding method, and memory storage |
TW105137835A TW201709742A (en) | 2010-07-15 | 2011-07-12 | Moving image decoding device and moving image decoding method |
TW105108792A TWI565307B (en) | 2010-07-15 | 2011-07-12 | Moving image encoding device, moving image decoding device, moving image encoding method, moving image decoding method, and memory storage |
HK13110333.0A HK1183189A1 (en) | 2010-07-15 | 2013-09-05 | Video encoding device, video decoding device, video encoding method, and video decoding method |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2010-160647 | 2010-07-15 | ||
JP2010160647 | 2010-07-15 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2012008125A1 true WO2012008125A1 (en) | 2012-01-19 |
Family
ID=45469144
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/JP2011/003907 WO2012008125A1 (en) | 2010-07-15 | 2011-07-07 | Video encoding device, video decoding device, video encoding method, and video decoding method |
Country Status (13)
Country | Link |
---|---|
US (1) | US9462271B2 (en) |
EP (1) | EP2595386A4 (en) |
JP (3) | JP5656998B2 (en) |
KR (5) | KR20140049095A (en) |
CN (5) | CN103004201B (en) |
BR (1) | BR112013000516B1 (en) |
CA (1) | CA2805328A1 (en) |
HK (5) | HK1222072A1 (en) |
MX (1) | MX2013000525A (en) |
RU (4) | RU2580073C2 (en) |
SG (2) | SG187062A1 (en) |
TW (3) | TW201709742A (en) |
WO (1) | WO2012008125A1 (en) |
Cited By (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012096150A1 (en) * | 2011-01-12 | 2012-07-19 | 三菱電機株式会社 | Dynamic image encoding device, dynamic image decoding device, dynamic image encoding method, and dynamic image decoding method |
JP2013541303A (en) * | 2011-01-07 | 2013-11-07 | メディア テック シンガポール ピーティーイー.リミテッド | Method and apparatus for improved intra prediction mode coding |
JP2014500692A (en) * | 2010-12-23 | 2014-01-09 | サムスン エレクトロニクス カンパニー リミテッド | Intra prediction mode encoding method and apparatus for video prediction unit, and intra prediction mode decoding method and apparatus for video prediction unit |
JP2014522193A (en) * | 2012-01-20 | 2014-08-28 | 華為技術有限公司 | Method and apparatus for encoding or decoding |
JP2014225928A (en) * | 2014-09-05 | 2014-12-04 | 株式会社Jvcケンウッド | Image encoding device, image encoding method, image encoding program, transmitting device, transmission method, and transmission program |
JP2015144484A (en) * | 2015-03-31 | 2015-08-06 | 株式会社Jvcケンウッド | Image decoder, image decoding method, image decoding program, receiver, receiving method and receiving program |
JP5839143B1 (en) * | 2015-09-09 | 2016-01-06 | 株式会社Jvcケンウッド | Image encoding device, image encoding method, image encoding program, transmission device, transmission method, and transmission program |
JP5839144B1 (en) * | 2015-09-09 | 2016-01-06 | 株式会社Jvcケンウッド | Image encoding device, image encoding method, image encoding program, transmission device, transmission method, and transmission program |
JP5839145B1 (en) * | 2015-09-09 | 2016-01-06 | 株式会社Jvcケンウッド | Image encoding device, image encoding method, image encoding program, transmission device, transmission method, and transmission program |
JP2016005210A (en) * | 2014-06-19 | 2016-01-12 | 三菱電機株式会社 | Terminal and data management device |
JP2016054509A (en) * | 2015-11-09 | 2016-04-14 | 株式会社Jvcケンウッド | Image encoding device |
TWI563826B (en) * | 2011-06-23 | 2016-12-21 | Jvc Kenwood Corp | |
RU2708295C1 (en) * | 2013-03-29 | 2019-12-05 | ДжейВиСи КЕНВУД КОРПОРЕЙШН | Image decoding device and method for decoding information relating to intra-frame prediction mode |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107743236B (en) * | 2012-04-12 | 2020-10-09 | 威勒斯媒体国际有限公司 | Receiver apparatus and transmitter apparatus |
WO2014038153A1 (en) * | 2012-09-10 | 2014-03-13 | パナソニック株式会社 | Image coding method, image decoding method, image coding device, image decoding device, and image coding/decoding device |
US20140185928A1 (en) * | 2012-12-28 | 2014-07-03 | Shai Ben NUN | Hardware-supported huffman coding of images |
CN103313055B (en) * | 2013-06-03 | 2016-04-20 | 电子科技大学 | A kind of chroma intra prediction method based on segmentation and video code and decode method |
US9967594B2 (en) * | 2013-06-28 | 2018-05-08 | Mozilla Corporation | Probability modeling of intra prediction modes |
WO2016074147A1 (en) * | 2014-11-11 | 2016-05-19 | Mediatek Singapore Pte. Ltd. | Separated coding tree for luma and chroma |
KR102411911B1 (en) * | 2015-12-24 | 2022-06-22 | 삼성전자주식회사 | Apparatus and method for frame rate conversion |
US10284844B1 (en) | 2018-07-02 | 2019-05-07 | Tencent America LLC | Method and apparatus for video coding |
JP7418152B2 (en) * | 2018-12-17 | 2024-01-19 | キヤノン株式会社 | Image encoding device, image encoding method, image decoding device, image decoding method |
JP6899053B2 (en) * | 2019-06-24 | 2021-07-07 | Kddi株式会社 | Image decoding device, image decoding method and program |
CN114258679A (en) * | 2019-08-19 | 2022-03-29 | 北京字节跳动网络技术有限公司 | Counter-based intra prediction mode |
WO2021032112A1 (en) | 2019-08-19 | 2021-02-25 | Beijing Bytedance Network Technology Co., Ltd. | Initialization for counter-based intra prediction mode |
US11475601B2 (en) * | 2019-10-21 | 2022-10-18 | Google Llc | Image decoding during bitstream interruptions |
Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007150913A (en) * | 2005-11-29 | 2007-06-14 | Matsushita Electric Ind Co Ltd | Image encoding device |
JP2009111691A (en) * | 2007-10-30 | 2009-05-21 | Hitachi Ltd | Image-encoding device and encoding method, and image-decoding device and decoding method |
Family Cites Families (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN100579232C (en) * | 1997-10-23 | 2010-01-06 | 三菱电机株式会社 | Image decoder anf image encoding method |
CA2265089C (en) * | 1998-03-10 | 2007-07-10 | Sony Corporation | Transcoding system using encoding history information |
EP1146745B1 (en) * | 2000-03-08 | 2019-09-04 | Mitsubishi Denki Kabushiki Kaisha | Coding device and coding method |
BR0201500A (en) * | 2001-01-30 | 2002-11-05 | Noa Kk Off | Method and system for compressing moving image information |
CN101039427B (en) * | 2002-07-15 | 2010-06-16 | 株式会社日立制作所 | Moving picture decoding method |
JP4617644B2 (en) * | 2003-07-18 | 2011-01-26 | ソニー株式会社 | Encoding apparatus and method |
US7830959B2 (en) * | 2003-12-26 | 2010-11-09 | Electronics And Telecommunications Research Institute | Apparatus and method for performing intra prediction for image decoder |
JP2006054846A (en) * | 2004-07-12 | 2006-02-23 | Sony Corp | Coding method and device, decoding method and device, and program thereof |
JP2006074474A (en) * | 2004-09-02 | 2006-03-16 | Toshiba Corp | Moving image encoder, encoding method, and encoding program |
RU2287909C2 (en) * | 2004-12-15 | 2006-11-20 | Московский технический университет связи и информатики | Method and device for converting digital picture signal |
EP1753242A2 (en) * | 2005-07-18 | 2007-02-14 | Matsushita Electric Industrial Co., Ltd. | Switchable mode and prediction information coding |
US20090123066A1 (en) * | 2005-07-22 | 2009-05-14 | Mitsubishi Electric Corporation | Image encoding device, image decoding device, image encoding method, image decoding method, image encoding program, image decoding program, computer readable recording medium having image encoding program recorded therein, |
CN102176754B (en) * | 2005-07-22 | 2013-02-06 | 三菱电机株式会社 | Image encoding device and method and image decoding device and method |
US20090034857A1 (en) * | 2005-07-22 | 2009-02-05 | Mitsubishi Electric Corporation | Image encoder and image decoder, image encoding method and image decoding method, image encoding program and image decoding program, and computer readable recording medium recorded with image encoding program and computer readable recording medium recorded with image decoding program |
KR20070077609A (en) | 2006-01-24 | 2007-07-27 | 삼성전자주식회사 | Method and apparatus for deciding intra prediction mode |
JP4707118B2 (en) | 2007-03-28 | 2011-06-22 | 株式会社Kddi研究所 | Intra prediction method for moving picture coding apparatus and moving picture decoding apparatus |
JP2010135864A (en) | 2007-03-29 | 2010-06-17 | Toshiba Corp | Image encoding method, device, image decoding method, and device |
US7991237B2 (en) * | 2007-06-28 | 2011-08-02 | Mitsubishi Electric Corporation | Image encoding device, image decoding device, image encoding method and image decoding method |
JP5137532B2 (en) * | 2007-11-16 | 2013-02-06 | キヤノン株式会社 | Image coding apparatus and image coding method |
KR101291196B1 (en) * | 2008-01-25 | 2013-07-31 | 삼성전자주식회사 | Video encoding method and apparatus, and video decoding method and apparatus |
KR101591825B1 (en) | 2008-03-27 | 2016-02-18 | 엘지전자 주식회사 | A method and an apparatus for encoding or decoding of a video signal |
KR101361005B1 (en) | 2008-06-24 | 2014-02-13 | 에스케이 텔레콤주식회사 | Intra Prediction Method and Apparatus and Image Encoding/Decoding Method and Apparatus Using Same |
JP4793424B2 (en) * | 2008-11-04 | 2011-10-12 | 三菱電機株式会社 | Image encoding apparatus, image encoding method, image decoding apparatus, image decoding method, and communication apparatus |
JP2010177809A (en) * | 2009-01-27 | 2010-08-12 | Toshiba Corp | Moving image encoding apparatus and moving image decoding apparatus |
JP5158003B2 (en) * | 2009-04-14 | 2013-03-06 | ソニー株式会社 | Image coding apparatus, image coding method, and computer program |
-
2011
- 2011-07-07 CN CN201180034748.8A patent/CN103004201B/en active Active
- 2011-07-07 BR BR112013000516-5A patent/BR112013000516B1/en active IP Right Grant
- 2011-07-07 CN CN201610230239.7A patent/CN105763875B/en active Active
- 2011-07-07 JP JP2012524443A patent/JP5656998B2/en active Active
- 2011-07-07 CA CA2805328A patent/CA2805328A1/en not_active Abandoned
- 2011-07-07 CN CN201610230356.3A patent/CN105657419B/en active Active
- 2011-07-07 KR KR1020147009217A patent/KR20140049095A/en not_active Application Discontinuation
- 2011-07-07 SG SG2013002779A patent/SG187062A1/en unknown
- 2011-07-07 WO PCT/JP2011/003907 patent/WO2012008125A1/en active Application Filing
- 2011-07-07 MX MX2013000525A patent/MX2013000525A/en active IP Right Grant
- 2011-07-07 US US13/810,072 patent/US9462271B2/en active Active
- 2011-07-07 CN CN201610230238.2A patent/CN105847792B/en active Active
- 2011-07-07 KR KR1020157012081A patent/KR20150059797A/en not_active Application Discontinuation
- 2011-07-07 KR KR1020147035797A patent/KR101562158B1/en active IP Right Grant
- 2011-07-07 RU RU2014134202/08A patent/RU2580073C2/en active
- 2011-07-07 KR KR1020137003840A patent/KR20130069726A/en not_active Application Discontinuation
- 2011-07-07 KR KR1020147022240A patent/KR101529452B1/en active IP Right Grant
- 2011-07-07 SG SG10201504903RA patent/SG10201504903RA/en unknown
- 2011-07-07 RU RU2013106507/08A patent/RU2533649C1/en active
- 2011-07-07 CN CN201610229316.7A patent/CN105847791B/en active Active
- 2011-07-07 EP EP11806461.7A patent/EP2595386A4/en not_active Ceased
- 2011-07-12 TW TW105137835A patent/TW201709742A/en unknown
- 2011-07-12 TW TW105108792A patent/TWI565307B/en active
- 2011-07-12 TW TW100124551A patent/TWI533676B/en active
-
2013
- 2013-09-05 HK HK16110114.2A patent/HK1222072A1/en unknown
- 2013-09-05 HK HK16110113.3A patent/HK1222071A1/en unknown
- 2013-09-05 HK HK16112122.8A patent/HK1224115A1/en unknown
- 2013-09-05 HK HK16112123.7A patent/HK1224116A1/en unknown
- 2013-09-05 HK HK13110333.0A patent/HK1183189A1/en unknown
-
2014
- 2014-10-21 JP JP2014214540A patent/JP5782169B2/en active Active
-
2015
- 2015-07-16 JP JP2015142083A patent/JP2015222973A/en active Pending
-
2016
- 2016-02-18 RU RU2016105489A patent/RU2632170C2/en active
-
2017
- 2017-09-06 RU RU2017131264A patent/RU2665237C1/en active
Patent Citations (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP2007150913A (en) * | 2005-11-29 | 2007-06-14 | Matsushita Electric Ind Co Ltd | Image encoding device |
JP2009111691A (en) * | 2007-10-30 | 2009-05-21 | Hitachi Ltd | Image-encoding device and encoding method, and image-decoding device and decoding method |
Non-Patent Citations (1)
Title |
---|
See also references of EP2595386A4 * |
Cited By (49)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US11070811B2 (en) | 2010-12-23 | 2021-07-20 | Samsung Electronics Co., Ltd. | Method and device for encoding intra prediction mode for image prediction unit, and method and device for decoding intra prediction mode for image prediction unit |
JP2014500692A (en) * | 2010-12-23 | 2014-01-09 | サムスン エレクトロニクス カンパニー リミテッド | Intra prediction mode encoding method and apparatus for video prediction unit, and intra prediction mode decoding method and apparatus for video prediction unit |
JP2016105619A (en) * | 2010-12-23 | 2016-06-09 | サムスン エレクトロニクス カンパニー リミテッド | Method and device for encoding intra prediction mode for image prediction unit, and method and device for decoding intra prediction mode for image prediction unit |
US10021384B2 (en) | 2010-12-23 | 2018-07-10 | Samsung Electronics Co., Ltd. | Method and device for encoding intra prediction mode for image prediction unit, and method and device for decoding intra prediction mode for image prediction unit |
US10630986B2 (en) | 2010-12-23 | 2020-04-21 | Samsung Electronics Co., Ltd. | Method and device for encoding intra prediction mode for image prediction unit, and method and device for decoding intra prediction mode for image prediction unit |
US11509899B2 (en) | 2010-12-23 | 2022-11-22 | Samsung Electronics Co., Ltd. | Method and device for encoding intra prediction mode for image prediction unit, and method and device for decoding intra prediction mode for image prediction unit |
JP2013541303A (en) * | 2011-01-07 | 2013-11-07 | メディア テック シンガポール ピーティーイー.リミテッド | Method and apparatus for improved intra prediction mode coding |
US8755435B2 (en) | 2011-01-07 | 2014-06-17 | Mediatek Inc. | Method and apparatus of improved intra prediction mode coding |
US10205944B2 (en) | 2011-01-12 | 2019-02-12 | Mistubishi Electric Corporation | Image encoding device, image decoding device, image encoding method, and image decoding method for generating a prediction image |
WO2012096150A1 (en) * | 2011-01-12 | 2012-07-19 | 三菱電機株式会社 | Dynamic image encoding device, dynamic image decoding device, dynamic image encoding method, and dynamic image decoding method |
US10931946B2 (en) | 2011-01-12 | 2021-02-23 | Mitsubishi Electric Corporation | Image encoding device, image decoding device, image encoding method, and image decoding method for generating a prediction image |
US9628797B2 (en) | 2011-01-12 | 2017-04-18 | Mitsubishi Electric Corporation | Image encoding device, image decoding device, image encoding method, and image decoding method for generating a prediction image |
JP2014132766A (en) * | 2011-01-12 | 2014-07-17 | Mitsubishi Electric Corp | Image encoder and image decoder |
US9609326B2 (en) | 2011-01-12 | 2017-03-28 | Mitsubishi Electric Corporation | Image encoding device, image decoding device, image encoding method, and image decoding method for generating a prediction image |
JP2017077036A (en) * | 2011-01-12 | 2017-04-20 | 三菱電機株式会社 | Encoded data |
JPWO2012096150A1 (en) * | 2011-01-12 | 2014-06-09 | 三菱電機株式会社 | Moving picture encoding apparatus, moving picture decoding apparatus, moving picture encoding method, and moving picture decoding method |
US9299133B2 (en) | 2011-01-12 | 2016-03-29 | Mitsubishi Electric Corporation | Image encoding device, image decoding device, image encoding method, and image decoding method for generating a prediction image |
JP2016042731A (en) * | 2011-01-12 | 2016-03-31 | 三菱電機株式会社 | Image encoding device, image decoding device, image encoding method, image decoding method, and bitstream |
JP2016042732A (en) * | 2011-01-12 | 2016-03-31 | 三菱電機株式会社 | Image encoding device, image decoding device, image encoding method, image decoding method, and bitstream |
JP2017118572A (en) * | 2011-01-12 | 2017-06-29 | 三菱電機株式会社 | Coding data |
US9736478B2 (en) | 2011-01-12 | 2017-08-15 | Mitsubishi Electric Corporation | Image encoding device, image decoding device, image encoding method, and image decoding method for generating a prediction image |
JP2017118571A (en) * | 2011-01-12 | 2017-06-29 | 三菱電機株式会社 | Coding data |
JP5478740B2 (en) * | 2011-01-12 | 2014-04-23 | 三菱電機株式会社 | Moving picture encoding apparatus, moving picture decoding apparatus, moving picture encoding method, and moving picture decoding method |
US9414073B2 (en) | 2011-01-12 | 2016-08-09 | Mitsubishi Electric Corporation | Image encoding device, image decoding device, image encoding method, and image decoding method for generating a prediction image |
JP2015084573A (en) * | 2011-01-12 | 2015-04-30 | 三菱電機株式会社 | Image encoder and image decoder |
US10009607B2 (en) | 2011-06-23 | 2018-06-26 | JVS KENWOOD Corporation | Picture coding device, picture coding method and picture coding program |
TWI563826B (en) * | 2011-06-23 | 2016-12-21 | Jvc Kenwood Corp | |
US10412384B2 (en) | 2011-06-23 | 2019-09-10 | JVC Kenwood Corporation | Picture coding device, picture coding method, picture coding program |
US10869033B2 (en) | 2011-06-23 | 2020-12-15 | JVC Kenwood Corporation | Picture coding device, picture coding method, picture coding program |
JP2016181908A (en) * | 2012-01-20 | 2016-10-13 | 華為技術有限公司Huawei Technologies Co.,Ltd. | Method and device for encoding or decoding |
JP2014522193A (en) * | 2012-01-20 | 2014-08-28 | 華為技術有限公司 | Method and apparatus for encoding or decoding |
US9503729B2 (en) | 2012-01-20 | 2016-11-22 | Huawei Technologies Co., Ltd. | Encoding or decoding method and apparatus |
US9351001B2 (en) | 2012-01-20 | 2016-05-24 | Huawei Technologies Co., Ltd. | Encoding or decoding method and apparatus |
US9325993B2 (en) | 2012-01-20 | 2016-04-26 | Huawei Technologies Co., Ltd. | Encoding or decoding method and apparatus |
US9743080B2 (en) | 2012-01-20 | 2017-08-22 | Huawei Technologies Co., Ltd. | Encoding or decoding method and apparatus |
US9906789B2 (en) | 2012-01-20 | 2018-02-27 | Huawei Technologies Co., Ltd. | Encoding or decoding method and apparatus |
US9124900B2 (en) | 2012-01-20 | 2015-09-01 | Huawei Technologies Co., Ltd. | Encoding or decoding method and apparatus |
JP2017085600A (en) * | 2012-01-20 | 2017-05-18 | 華為技術有限公司Huawei Technologies Co.,Ltd. | Method and device for encoding or decoding |
RU2708295C1 (en) * | 2013-03-29 | 2019-12-05 | ДжейВиСи КЕНВУД КОРПОРЕЙШН | Image decoding device and method for decoding information relating to intra-frame prediction mode |
RU2708506C1 (en) * | 2013-03-29 | 2019-12-09 | ДжейВиСи КЕНВУД КОРПОРЕЙШН | Image decoding device and method for decoding information relating to intra-frame prediction mode |
RU2708295C9 (en) * | 2013-03-29 | 2021-03-03 | ДжейВиСи КЕНВУД КОРПОРЕЙШН | A picture decoding device and method for decoding information regarding an intra-prediction mode |
RU2708506C9 (en) * | 2013-03-29 | 2020-10-16 | ДжейВиСи КЕНВУД КОРПОРЕЙШН | A picture decoding device and method for decoding information regarding an intra-prediction mode |
JP2016005210A (en) * | 2014-06-19 | 2016-01-12 | 三菱電機株式会社 | Terminal and data management device |
JP2014225928A (en) * | 2014-09-05 | 2014-12-04 | 株式会社Jvcケンウッド | Image encoding device, image encoding method, image encoding program, transmitting device, transmission method, and transmission program |
JP2015144484A (en) * | 2015-03-31 | 2015-08-06 | 株式会社Jvcケンウッド | Image decoder, image decoding method, image decoding program, receiver, receiving method and receiving program |
JP5839145B1 (en) * | 2015-09-09 | 2016-01-06 | 株式会社Jvcケンウッド | Image encoding device, image encoding method, image encoding program, transmission device, transmission method, and transmission program |
JP5839143B1 (en) * | 2015-09-09 | 2016-01-06 | 株式会社Jvcケンウッド | Image encoding device, image encoding method, image encoding program, transmission device, transmission method, and transmission program |
JP5839144B1 (en) * | 2015-09-09 | 2016-01-06 | 株式会社Jvcケンウッド | Image encoding device, image encoding method, image encoding program, transmission device, transmission method, and transmission program |
JP2016054509A (en) * | 2015-11-09 | 2016-04-14 | 株式会社Jvcケンウッド | Image encoding device |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP5782169B2 (en) | Moving picture coding apparatus and moving picture coding method | |
JP6851429B2 (en) | Image decoding device, image decoding method, image coding device and image coding method | |
US11831893B2 (en) | Image coding device, image decoding device, image coding method, and image decoding method | |
JP2012023609A (en) | Moving image encoding device, moving image decoding device, moving image encoding method and moving image decoding method | |
JP2013098715A (en) | Moving image encoder, moving image decoder, moving image encoding method and moving image decoding method |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 11806461 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2012524443 Country of ref document: JP |
|
ENP | Entry into the national phase |
Ref document number: 2805328 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 13810072 Country of ref document: US Ref document number: MX/A/2013/000525 Country of ref document: MX |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2011806461 Country of ref document: EP |
|
ENP | Entry into the national phase |
Ref document number: 2013106507 Country of ref document: RU Kind code of ref document: A Ref document number: 20137003840 Country of ref document: KR Kind code of ref document: A |
|
REG | Reference to national code |
Ref country code: BR Ref legal event code: B01A Ref document number: 112013000516 Country of ref document: BR |
|
ENP | Entry into the national phase |
Ref document number: 112013000516 Country of ref document: BR Kind code of ref document: A2 Effective date: 20130108 |