US20120236943A1 - Video encoding and decoding method and apparatus using weighted prediction - Google Patents
Video encoding and decoding method and apparatus using weighted prediction Download PDFInfo
- Publication number
 - US20120236943A1 US20120236943A1 US13/482,364 US201213482364A US2012236943A1 US 20120236943 A1 US20120236943 A1 US 20120236943A1 US 201213482364 A US201213482364 A US 201213482364A US 2012236943 A1 US2012236943 A1 US 2012236943A1
 - Authority
 - US
 - United States
 - Prior art keywords
 - current block
 - regions
 - motion vectors
 - video encoding
 - reference blocks
 - Prior art date
 - Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
 - Abandoned
 
Links
Images
Classifications
- 
        
- H—ELECTRICITY
 - H04—ELECTRIC COMMUNICATION TECHNIQUE
 - H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 - H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
 - H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
 - H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
 - H04N19/51—Motion estimation or motion compensation
 - H04N19/573—Motion compensation with multiple frame prediction using two or more reference frames in a given prediction direction
 
 - 
        
- H—ELECTRICITY
 - H04—ELECTRIC COMMUNICATION TECHNIQUE
 - H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 - H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
 - H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
 - H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
 - H04N19/103—Selection of coding mode or of prediction mode
 - H04N19/105—Selection of the reference unit for prediction within a chosen coding or prediction mode, e.g. adaptive choice of position and number of pixels used for prediction
 
 - 
        
- H—ELECTRICITY
 - H04—ELECTRIC COMMUNICATION TECHNIQUE
 - H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 - H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
 - H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
 - H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
 - H04N19/136—Incoming video signal characteristics or properties
 - H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
 
 - 
        
- H—ELECTRICITY
 - H04—ELECTRIC COMMUNICATION TECHNIQUE
 - H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 - H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
 - H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
 - H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
 - H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
 
 - 
        
- H—ELECTRICITY
 - H04—ELECTRIC COMMUNICATION TECHNIQUE
 - H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 - H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
 - H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
 - H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
 - H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
 - H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
 
 - 
        
- H—ELECTRICITY
 - H04—ELECTRIC COMMUNICATION TECHNIQUE
 - H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 - H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
 - H04N19/46—Embedding additional information in the video signal during the compression process
 
 - 
        
- H—ELECTRICITY
 - H04—ELECTRIC COMMUNICATION TECHNIQUE
 - H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 - H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
 - H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
 - H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
 - H04N19/51—Motion estimation or motion compensation
 
 - 
        
- H—ELECTRICITY
 - H04—ELECTRIC COMMUNICATION TECHNIQUE
 - H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
 - H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
 - H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
 - H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
 
 
Definitions
- Apparatuses and methods consistent with the present invention generally relate to video encoding and decoding, and more particularly, to video encoding and decoding in which a current block can be accurately predicted using weighted prediction and an image is encoded and decoded based on the prediction result.
 - MPEG-1 Moving Picture Experts Group
 - MPEG-2 MPEG-2
 - AVC H.264/MPEG-4 Advanced Video Coding
 - Video encoding using interprediction involves video compression by means of removal of temporal redundancy between pictures and a representative example thereof is motion estimation encoding.
 - motion estimation encoding motion of a current picture is estimated and compensated for in block units using at least one reference picture for video encoding.
 - a block that is most similar to the current block is searched for in a predetermined search range of at least one reference picture using a predetermined evaluation function. Once the similar block is found, only a residual block between the current block and the found block is transmitted, thereby improving the data compression rate.
 - Blocks of various sizes such as 16 ⁇ 16, 8 ⁇ 16, 8 ⁇ 8, or the like can be used in motion estimation encoding.
 - H.264/AVC provides a prediction mode called weighted prediction. This prediction mode is usually used to predict the brightness of an image. For an image whose brightness changes over time such as when the image fades in or fades out, image encoding having no consideration regarding the brightness of the image may lead to significant degradation in the display quality of the image.
 - H.264/AVC provides a method of performing prediction by adaptively weighting a reference picture.
 - FIG. 1 illustrates an example of weighted prediction according to the related art.
 - a current picture 110 is a bidirectional (B) picture and is interpredicted using two reference pictures # 0 120 and # 1 130 .
 - B bidirectional
 - two reference blocks 122 and 132 corresponding to the current block 112 are selected from the reference pictures 120 and 130 , respectively.
 - a block that is most similar to the current block 112 is selected using a predetermined evaluation function.
 - Two motion vectors MV 0 and MV 1 are estimated for interprediction of the current block 112 .
 - the current block 112 is then predicted using weighted prediction.
 - Weights are calculated based on temporal distances between the current picture 110 and the reference pictures 120 and 130 .
 - R 0 indicates the reference block 122 corresponding to the current block 112 , which is included in the reference picture 120
 - R 1 indicates the reference block 132 corresponding to the current block 112 , which is included in the reference picture 130
 - D is an offset that may be ‘0’.
 - the weights are calculated based on temporal distances between the current picture 110 and the reference pictures 120 and 130 as illustrated in FIG. 1 , it is not necessary to separately encode the weights used in prediction of the current block 112 , which is called an implicit mode.
 - the weights are set at random instead of being calculated based on the temporal distances, the weights used in prediction of the current block 112 have to be separately encoded, which is called an explicit mode.
 - the present invention provides a video encoding and decoding method and apparatus in which weighted prediction can be accurately performed during prediction-encoding and decoding of an image, and a computer-readable recording medium having recorded thereon a program for executing the video encoding and decoding method.
 - a video encoding method including estimating a plurality of motion vectors required for interprediction of a current block and selecting a plurality of reference blocks based on the plurality of estimated motion vectors, dividing the current block into a plurality of regions and setting weights assigned to the plurality of reference blocks for interprediction independently for each of the regions, predicting the current block from the plurality of reference blocks based on the setting result, and encoding the current block based on the prediction result.
 - the plurality of motion vectors may be motion vectors for a plurality of sub-blocks included in the current block, and each of the reference blocks may have the same size as that of the current block.
 - the plurality of motion vectors may be motion vectors for bi-predictive prediction of the current block, and each of the reference blocks may have the same size as that of the current block.
 - the encoding of the current block may have encoding information about the plurality of regions and information about the set weights.
 - a video encoding apparatus including a motion estimation unit, a motion compensation unit, and an encoding unit.
 - the motion estimation unit estimates a plurality of motion vectors required for interprediction of a current block and selects a plurality of reference blocks based on the plurality of estimated motion vectors.
 - the motion compensation unit divides the current block into a plurality of regions and sets weights assigned to the plurality of reference blocks for interprediction independently for each of the regions and predicting the current block from the plurality of reference blocks based on the setting result.
 - the encoding unit encodes the current block based on the prediction result.
 - the encoding unit may encode information about the plurality of regions and information about the set weights.
 - a video decoding method including receiving a bitstream including data about a residual block of a current block, extracting the data about the residual block, information about a plurality of motion vectors required for interprediction of the current block, information about a plurality of regions obtained by dividing the current block for the interprediction, and information about weights set independently for each of the regions from the received bitstream, predicting the plurality of regions using the information about the weights and a plurality of reference blocks selected based on the information about the plurality of motion vectors, and reconstructing the current block based on the prediction result and the data about the residual block.
 - a video decoding apparatus including a decoding unit, a motion compensation unit, and a reconstruction unit.
 - the decoding unit receives a bitstream including data about a residual block of a current block and extracts the data about the residual block, information about a plurality of motion vectors required for interprediction of the current block, information about a plurality of regions obtained by dividing the current block for the interprediction, and information about weights set independently for each of the regions from the received bitstream.
 - the motion compensation unit predicts the plurality of regions using the information about the weights and a plurality of reference blocks selected based on the information about the plurality of motion vectors.
 - the reconstruction unit reconstructs the current block based on the prediction result and the data about the residual block.
 - a computer-readable recording medium having recorded thereon a program for executing the video encoding and decoding method.
 - FIG. 1 illustrates an example of weighted prediction according to the related art
 - FIG. 2 is a block diagram of a video encoding apparatus according to an exemplary embodiment of the present invention
 - FIGS. 3A and 3B illustrate a plurality of motion vectors according to an exemplary embodiment of the present invention
 - FIG. 4 is a diagram for explaining weight prediction according to an exemplary embodiment of the present invention.
 - FIGS. 5A through 5D illustrate a plurality of weighting partitions according to an exemplary embodiment of the present invention
 - FIG. 6 is a diagram for explaining weight prediction according to another exemplary embodiment of the present invention.
 - FIGS. 7A through 7C illustrate cutting points according to an exemplary embodiment of the present invention
 - FIG. 8 is a block diagram of a video encoding apparatus according to another exemplary embodiment of the present invention.
 - FIG. 9 is a flowchart of a video encoding method according to an exemplary embodiment of the present invention.
 - FIG. 10 is a block diagram of a video decoding apparatus according to an exemplary embodiment of the present invention.
 - FIG. 11 is a flowchart of a video decoding method according to an exemplary embodiment of the present invention.
 - FIG. 2 is a block diagram of a video encoding apparatus 200 according to an exemplary embodiment of the present invention.
 - the video encoding apparatus 200 includes a motion estimation unit 210 , a motion compensation unit 220 , and an encoding unit 230 .
 - the motion estimation unit 210 estimates a plurality of motion vectors required for interprediction of a current block and selects a plurality of reference blocks based on the estimated motion vectors.
 - the video encoding apparatus 200 performs interprediction by setting weights to be assigned to the plurality of reference blocks, which are different from region to region. To this end, the motion estimation unit 210 first estimates the plurality of motion vectors required for interprediction of the current block.
 - the plurality of motion vectors can be estimated in various ways, the plurality of motion vectors that help to predict the most approximate value for the current block using weighted prediction according to the present invention are calculated.
 - the current block is divided into M regions and there are N combinations of weights assigned to the plurality of reference blocks referred to by the current block. Since N combinations of weights are available for each of the M regions, M ⁇ N combinations of weights can be used for interprediction of the current block.
 - the plurality of motion vectors are estimated for each of the M ⁇ N combinations. Based on the estimation result, one of the M ⁇ N combinations and corresponding motion vectors in which a residual block between the current block and a prediction block thereof is smallest are selected.
 - an initial value may be set for the plurality of motion vectors and the optimal motion vector for each of the motion vectors may be estimated one-by-one.
 - an initial value for the motion vectors MV 0 and MV 1 is set.
 - the motion vector MV 1 is fixed to the initial value and the optimal motion vector MV 0 is estimated according to the M ⁇ N combinations described above.
 - the estimated optimal motion vector MV 0 is fixed to MV 0
 - the optimal motion vector MV 1 is estimated according to the M ⁇ N combinations described above.
 - the plurality of motion vectors are estimated according to various combinations of weights, the amount of calculation performed by the video encoding apparatus 200 increases, resulting in a reduction in encoding speed.
 - the plurality of motion vectors required for prediction of the current block can also be estimated as illustrated in FIGS. 3A and 3B .
 - FIGS. 3A and 3B illustrate a plurality of motion vectors for a current block 310 , according to an exemplary embodiment of the present invention.
 - the current block 310 includes sub-blocks 312 and 314 .
 - a motion vector is estimated for each of the sub-blocks 312 and 314 included in the current block 310 , and the estimated motion vectors may be used as the plurality of motion vectors for the current block 310 .
 - the motion estimation unit 210 estimates a motion vector MV 0 for the sub-block 312 located in an upper portion of the current block 310 .
 - a block that is most similar to the sub-block 312 is searched for in at least one reference picture, and the motion vector MV 0 for the sub-block 312 is estimated according to the search result.
 - a motion vector MV 1 for the sub-block 314 located in a lower portion of the current block 310 is estimated by searching the at least one reference picture.
 - the motion vectors MV 0 and MV 1 for the sub-blocks 312 and 314 serve as the plurality of motion vectors required for interprediction of the current block 310 .
 - FIG. 3B is a diagram for explaining prediction of a current block 312 using bi-predictive prediction, according to an exemplary embodiment of the present invention.
 - the current block 312 is predicted from blocks 322 and 332 included in a plurality of different pictures 320 and 330 that temporally precede or follow a current picture 310 similar to that as shown in FIG. 1 .
 - the current block 312 is predicted by referring to a plurality of reference blocks 322 and 332 included in the different pictures 320 and 330 .
 - the blocks 322 and 332 that are most similar to the current block 312 are searched for in the reference pictures 320 and 330 , and the found blocks 322 and 332 are referred to.
 - motion vectors MV 0 and MV 1 indicating the plurality of reference blocks 322 and 332 serve as a plurality of motion vectors required for interprediction of the current block 312 .
 - the motion compensation unit 220 performs interprediction on the current block using the estimated motion vectors using weighted prediction according to an exemplary embodiment of the present invention.
 - the current block is divided into a plurality of regions and weights assigned to a plurality of reference blocks are set independently for each of the regions for interprediction of the current block, as will be described in detail with reference to FIG. 4 .
 - FIG. 4 is a diagram for explaining weighted prediction according to an exemplary embodiment of the present invention.
 - weighted prediction is performed on the current block by referring to four different reference blocks.
 - the motion compensation unit 220 divides the current block into a plurality of regions in order to set a weighting partition 400 .
 - the motion compensation unit 220 multiplies the reference pictures 410 , 420 , 430 , and 440 with the weighting partition 400 .
 - weights for the reference pictures 410 , 420 , 430 , and 440 are set independently for each of a plurality of weighting regions 402 , 404 , 406 , and 408 included in the weighting partition 400 .
 - a weight of 0.2 is set for the reference picture 410
 - a weight of 0.4 is set for the reference picture 420
 - a weight of 0.1 is set for the reference picture 430
 - a weight of 0.3 is set for the reference picture 440 .
 - the weights assigned to the reference pictures change from weighting region to weighting region, allowing flexible weighted prediction.
 - Blocks 412 , 422 , 432 , and 442 generated by the multiplication are summed up, thereby generating a prediction block 450 of the current block.
 - Weights assigned to the reference pictures 410 , 420 , 430 , and 440 are not also limited to the example illustrated in FIG. 4 .
 - infinite decimal fractions between 0 and 1 may be used as the weights.
 - weight information about the weights can be efficiently encoded by limiting the number of weights that can be set, as will be described later with reference to FIG. 6 .
 - FIGS. 5A through 5D illustrate a plurality of weighting partitions according to an exemplary embodiment of the present invention.
 - the motion compensation unit 220 sets the weighting regions by dividing the current block for flexible weighted prediction.
 - the current block is divided in a horizontal direction in FIG. 5A , the current block is divided in a vertical directions in FIG. 5B , and the current block is divided in an oblique direction in FIG. 5C .
 - the current block is hierarchically divided into regular squares as in conventional video encoding.
 - the current block can be divided in various other ways for setting a weighting partition without being limited to the weighting partitions illustrated in FIGS. 5A through 5D .
 - FIG. 6 is a diagram for explaining weighted prediction according to another exemplary embodiment of the present invention.
 - the motion estimation unit 220 performs weighted prediction when a weighting partition is set as illustrated in FIG. 5A .
 - the number of weighting regions of the weighting partition i.e., N P
 - the number of weight interval between 0 and 1, i.e., N W is equal to 3.
 - weights assigned to the reference blocks 610 and 620 are set independently for each of a plurality of weighting regions 602 , 604 , 606 , and 608 .
 - a weight W 0 is assigned to the reference block 610 for the weighting region 602 located uppermost in the current block 600
 - a weight W 1 is assigned to the reference block 610 for the weighting region 604 located second from the top
 - a weight W 2 is assigned to the reference block 610 for the weighting region 606 located third from the top
 - a weight W 3 is assigned to the reference block 610 for the weighting region 608 located lowermost in the current block 600 .
 - weights of (1-W N ) are assigned to the reference block 620 in descending order from the top of the current block 600 .
 - N may be 0, 1, 2, and 3. Since only the two reference blocks 610 and 620 are used, upon determination of the weights W N for one of the reference blocks, the weights (1-W N ) for the other reference block can also be determined.
 - weights that can be assigned are limited to 0, 1 ⁇ 3, 2 ⁇ 3, and 1.
 - the motion compensation unit 220 predicts the current block 600 according to the assigned weights.
 - the weighting region 602 located uppermost in the current block 600 is predicted using corresponding regions of the reference blocks 610 and 620 .
 - prediction values of the weighting regions 602 , 604 , 606 , and 608 are P 0 , P 1 , P 2 , and P 3 , respectively, they can be set according to the assigned weights, as follows.
 - the current block 600 can also be predicted by adding a predetermined offset value D N to P 0 , P 1 , P 2 , and P 3 .
 - N may be 0, 1, 2, and 3.
 - the encoding unit 230 encodes the current block based on the prediction result obtained by the motion compensation unit 220 . Once a prediction block of the current block is generated by prediction of the motion compensation unit 220 , the encoding unit 230 generates a residual block by subtracting the prediction block from the current block. The encoding unit 230 then performs a Discrete Cosine Transform (DCT) on the residual block and quantizes coefficients resulting from the DCT. The encoding unit 230 performs entropy-coding on the quantized coefficients, thereby generating a bitstream. During encoding, the encoding unit 230 also encodes weighting partition information and weight information and inserts the encoded information into the bitstream.
 - DCT Discrete Cosine Transform
 - the weighting partition information indicates how the current block is divided into a plurality of regions and the weight information indicates weights assigned to reference blocks, which are set independently for each of the regions.
 - FIGS. 7A through 7C illustrate cutting points according to an exemplary embodiment of the present invention.
 - the encoding unit 230 also encodes information about the dividing shape. For example, a cutting point according to the boundary of a region, i.e., information about vertical coordinates 710 or horizontal coordinates 720 at which a boundary 702 or 704 of a region intersects a boundary of the current block 700 , is encoded and then inserted into a bitstream.
 - FIG. 8 is a block diagram of a video encoding apparatus 800 according to another exemplary embodiment of the present invention.
 - the video encoding apparatus 800 includes a motion estimation unit 810 , a motion compensation unit 820 , a subtraction unit 830 , an encoding unit 840 , a decoding unit 850 , a reconstruction unit 860 , and a picture memory 870 .
 - the motion estimation unit 810 searches reference pictures stored in the picture memory 870 in order to estimate a plurality of motion vectors required for interprediction of a current block.
 - the motion estimation unit 810 estimates a plurality of motion vectors that help to predict the most approximate value for the current block by searching the reference pictures when weighted prediction according to the present invention is performed.
 - the motion estimation unit 810 may also estimate a motion vector for each sub-block included in the current block and use the estimated motion vectors as motion vectors required for interprediction of the current block as in the prior art. In this case, the motion estimation unit 810 searches in a reference picture for a block that is most similar to each sub-block and estimates the motion vector for each sub-block.
 - the motion estimation unit 810 may also estimate the motion vectors for the current block using bi-predictive prediction.
 - Reference blocks corresponding to the current block are selected by searching a plurality of different pictures that temporally precede or follow the current block, thereby estimating the motion vectors for the current block.
 - the motion compensation unit 820 interpredicts the current block using the plurality of motion vectors estimated by the motion estimation unit 810 . In other words, the motion compensation unit 820 interpredicts the current block using flexible weighted prediction described above with reference 10 FIGS. 4 and 6 .
 - the subtraction unit 830 subtracts a prediction block generated by interprediction of the motion compensation unit 820 from the current block, thereby generating a residual block.
 - the encoding unit 840 encodes the residual block generated by the subtraction unit 830 . More specifically, the encoding unit 840 performs DCT on the residual block in order to generate DCT coefficients and quantizes the generated DCT coefficients. The encoding unit 840 then performs entropy-coding on the quantized DCT coefficients, thereby generating a bitstream.
 - the decoding unit 850 decodes the residual block encoded by the encoding unit 840 , thereby reconstructing the residual block. More specifically, the decoding unit 850 performs inverse quantization and inverse DCT on the encoded residual block, thereby reconstructing the residual block.
 - the reconstruction unit 860 adds the prediction block generated by the motion compensation unit 820 to the residual block reconstructed by the decoding unit 850 , thereby reconstructing the current block.
 - the reconstructed current block is stored in the picture memory 870 for use in prediction of a next block or a next picture.
 - FIG. 9 is a flowchart of a video encoding method according to an exemplary embodiment of the present invention.
 - a video encoding apparatus estimates a plurality of motion vectors required for interprediction of a current block and selects a plurality of reference blocks based on the estimated motion vectors.
 - motion vectors that guarantee the best performance of prediction for the current block using flexible weighted prediction may be estimated or motion vector estimation according to the related art may be used.
 - motion vectors for sub-blocks included in the current block may be used as the motion vectors for the current block, or the motion vectors for the current block may be estimated by searching pictures that temporally precede or follow the current block using bi-predictive prediction.
 - the video encoding apparatus divides the current block into a plurality of regions and sets weights assigned to the selected reference blocks independently for each of the regions.
 - the video encoding apparatus predicts the current block from the plurality of reference blocks based on the setting result of operation 920 . As discussed above with reference to FIGS. 4 and 6 , weighted prediction is performed using different weight combinations for different regions of the current block, thereby accurately predicting the current block.
 - the video encoding apparatus encodes the current block based on the prediction result of operation 930 .
 - a prediction block generated by the prediction is subtracted from the current block, thereby generating a residual block.
 - DCT is performed on the generated residual block, thereby generating DCT coefficients.
 - the generated DCT coefficients are quantized and entropy-coded, and then inserted into a bitstream.
 - FIG. 10 is a block diagram of a video decoding apparatus 1000 according to an exemplary embodiment of the present invention.
 - the video decoding apparatus 1000 includes a decoding unit 1010 , a motion compensation unit 1020 , a reconstruction unit 1030 , and a picture memory 1040 .
 - the decoding unit 1010 receives a bitstream including data about a residual block of a current block.
 - the decoding unit 1010 extracts the data about the residual block, information about a plurality of motion vectors required for prediction of the current block, information about a weighting partition including a plurality of regions for weighted prediction of the current block, and information about weights set independently for each of the regions from the received bitstream.
 - the decoding unit 1010 performs entropy-decoding and inverse quantization on the extracted data about the residual block, thereby generating DCT coefficients.
 - the decoding unit 1010 performs inverse DCT on the generated DCT coefficients, thereby reconstructing a residual block.
 - Information about a weighting partition including the plurality of regions may indicate the number of regions as described regarding the encoding unit 230 or a cutting point at which the boundary of a region intersects the boundary of the current block as described with reference to FIGS. 7A and 7B .
 - the motion compensation unit 1020 interpredicts the current block based on the data extracted by the decoding unit 1010 .
 - the motion compensation unit 1020 performs flexible weighted prediction described above with reference to FIGS. 4 and 6 .
 - the motion compensation unit 1020 searches reference pictures stored in the picture memory 1040 based on the plurality of motion vectors extracted by the decoding unit 1010 and selects a plurality of reference blocks for interprediction of the current block.
 - the plurality of reference blocks may be selected from a single picture or a plurality of pictures that temporally precede or follow the current block.
 - the motion compensation unit 1020 then performs flexible weighted prediction using the selected reference blocks.
 - the motion compensation unit 1020 interpredicts the current block based on the information about the weighting partition including the plurality of regions of the current block divided for interprediction and the information about weights set independently for each of the regions.
 - the motion compensation unit 1020 divides the current block into a plurality of regions based on the information about the weighting partition extracted by the decoding unit 1010 and assigns the weights set independently for each of the regions to the reference blocks, thereby performing weighted prediction on the current block.
 - the reconstruction unit 1030 reconstructs the current block based on a prediction block generated by the prediction of the motion compensation unit 1020 and the residual block decoded by the decoding unit 1010 . More specifically, the reconstruction unit 1030 adds the prediction block to the residual block, thereby reconstructing the current block.
 - the reconstructed current block is stored in the picture memory 1040 for use in prediction of a next block or a next picture.
 - FIG. 11 is a flowchart of a video decoding method according to an exemplary embodiment of the present invention.
 - a video decoding apparatus receives a bitstream including data about a residual block of a current block in operation 1110 .
 - the video decoding apparatus extracts the data about the residual block, information about a plurality of motion vectors required for prediction of the current block, information about a weighting partition including a plurality of regions for weighted prediction of the current block, and information about weights set independently for each of the regions from the bitstream received in operation 1110 .
 - the video decoding apparatus reconstructs the data about the residual block by performing entropy decoding, inverse quantization, and inverse DCT.
 - the video decoding apparatus interpredicts the current block based on the information extracted in operation 1120 . More specifically, the video decoding apparatus selects a plurality of reference blocks required for interprediction of the current block based on the extracted information about the plurality of motion vectors and performs weighted prediction by setting weights assigned to the plurality of reference blocks independently for each of the regions.
 - the video decoding apparatus reconstructs the current block based on a prediction block generated by the prediction of operation 1130 and the residual block reconstructed in operation 1120 . More specifically, the video decoding apparatus reconstructs the current block by adding the prediction block to the residual block.
 - a current block can be accurately interpredicted during video encoding and decoding, thereby improving the compression rate of video encoding.
 - regions obtained by dividing the current block can be predicted using different weight combinations, thereby making flexible weighted prediction possible.
 - the exemplary embodiments of the present invention can be written as computer programs and can be implemented in general-use digital computers that execute the programs using a computer readable recording medium.
 - Examples of the computer readable recording medium include magnetic storage media (e.g., ROM, floppy disks, hard disks, etc.), and optical recording media (e.g., CD-ROMs, or DVDs).
 - the computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
 
Landscapes
- Engineering & Computer Science (AREA)
 - Multimedia (AREA)
 - Signal Processing (AREA)
 - Compression Or Coding Systems Of Tv Signals (AREA)
 - Compression, Expansion, Code Conversion, And Decoders (AREA)
 
Abstract
Provided is a video encoding and decoding method and apparatus. The video encoding method includes selecting a plurality of reference blocks based on a plurality of motion vectors and setting weights assigned to the plurality of reference blocks independently for each of a plurality of regions of a current block in order to predict and encode the current block, thereby providing a new encoding mode allowing accurate prediction of the current block and thus improving the compression rate of video encoding.
  Description
-  CROSS-REFERENCE TO RELATED PATENT APPLICATION
 -  This is a divisional of application Ser. No. 12/132,637 filed Jun. 4, 2008. The entire disclosure of application Ser. No. 12/132,637 is considered part of the disclosure of the accompanying divisional application and is hereby incorporated by reference. This application claims priority from Korean Patent Application No. 10-2007-0077164, filed on Jul. 31, 2007, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein in its entirety by reference.
 -  1. Field of the Invention
 -  Apparatuses and methods consistent with the present invention generally relate to video encoding and decoding, and more particularly, to video encoding and decoding in which a current block can be accurately predicted using weighted prediction and an image is encoded and decoded based on the prediction result.
 -  2. Description of the Related Art
 -  In video compression standards such as Moving Picture Experts Group (MPEG-1), MPEG-2, and H.264/MPEG-4 Advanced Video Coding (AVC), a picture is divided into macroblocks for video encoding. Each of the macroblocks is then encoded using interprediction or intraprediction.
 -  Video encoding using interprediction involves video compression by means of removal of temporal redundancy between pictures and a representative example thereof is motion estimation encoding. In motion estimation encoding, motion of a current picture is estimated and compensated for in block units using at least one reference picture for video encoding.
 -  In motion estimation encoding, a block that is most similar to the current block is searched for in a predetermined search range of at least one reference picture using a predetermined evaluation function. Once the similar block is found, only a residual block between the current block and the found block is transmitted, thereby improving the data compression rate. Blocks of various sizes such as 16×16, 8×16, 8×8, or the like can be used in motion estimation encoding.
 -  For interprediction, H.264/AVC provides a prediction mode called weighted prediction. This prediction mode is usually used to predict the brightness of an image. For an image whose brightness changes over time such as when the image fades in or fades out, image encoding having no consideration regarding the brightness of the image may lead to significant degradation in the display quality of the image. Thus, H.264/AVC provides a method of performing prediction by adaptively weighting a reference picture.
 -  
FIG. 1 illustrates an example of weighted prediction according to the related art. -  Referring to
FIG. 1 , it is assumed that acurrent picture 110 is a bidirectional (B) picture and is interpredicted using tworeference pictures # 0 120 and #1 130. To predict acurrent block 112 included in thecurrent picture 110, two 122 and 132 corresponding to thereference blocks current block 112 are selected from the 120 and 130, respectively. A block that is most similar to thereference pictures current block 112 is selected using a predetermined evaluation function. -  Two motion vectors MV0 and MV1 are estimated for interprediction of the
current block 112. Thecurrent block 112 is then predicted using weighted prediction. -  Weights are calculated based on temporal distances between the
current picture 110 and the 120 and 130. A weight W1 assigned to thereference pictures reference picture 130 is calculated by W1=tb/td, where tb is the temporal distance between thereference picture 120 and thecurrent picture 110, and td is the temporal distance between thereference picture 120 and thereference picture 130. A weight W0 assigned to thereference picture 120 is calculated by W0=1−W1. -  Once the weights are assigned to the
 120 and 130, a prediction block P of thereference pictures current block 112 is obtained by P=W0*R0+W1*R1+D. R0 indicates thereference block 122 corresponding to thecurrent block 112, which is included in thereference picture 120, R1 indicates thereference block 132 corresponding to thecurrent block 112, which is included in thereference picture 130, and D is an offset that may be ‘0’. -  When the weights are calculated based on temporal distances between the
current picture 110 and the 120 and 130 as illustrated inreference pictures FIG. 1 , it is not necessary to separately encode the weights used in prediction of thecurrent block 112, which is called an implicit mode. On the other hand, when the weights are set at random instead of being calculated based on the temporal distances, the weights used in prediction of thecurrent block 112 have to be separately encoded, which is called an explicit mode. -  In weighted prediction illustrated in
FIG. 1 , however, since the particular weights W0 and W1 are assigned for the 122 and 132, the accuracy of predicting each block included in thereference blocks current picture 110 degrades. -  The present invention provides a video encoding and decoding method and apparatus in which weighted prediction can be accurately performed during prediction-encoding and decoding of an image, and a computer-readable recording medium having recorded thereon a program for executing the video encoding and decoding method.
 -  According to an aspect of the present invention, there is provided a video encoding method including estimating a plurality of motion vectors required for interprediction of a current block and selecting a plurality of reference blocks based on the plurality of estimated motion vectors, dividing the current block into a plurality of regions and setting weights assigned to the plurality of reference blocks for interprediction independently for each of the regions, predicting the current block from the plurality of reference blocks based on the setting result, and encoding the current block based on the prediction result.
 -  The plurality of motion vectors may be motion vectors for a plurality of sub-blocks included in the current block, and each of the reference blocks may have the same size as that of the current block.
 -  The plurality of motion vectors may be motion vectors for bi-predictive prediction of the current block, and each of the reference blocks may have the same size as that of the current block.
 -  The encoding of the current block may have encoding information about the plurality of regions and information about the set weights.
 -  According to another aspect of the present invention, there is provided a video encoding apparatus including a motion estimation unit, a motion compensation unit, and an encoding unit. The motion estimation unit estimates a plurality of motion vectors required for interprediction of a current block and selects a plurality of reference blocks based on the plurality of estimated motion vectors. The motion compensation unit divides the current block into a plurality of regions and sets weights assigned to the plurality of reference blocks for interprediction independently for each of the regions and predicting the current block from the plurality of reference blocks based on the setting result. The encoding unit encodes the current block based on the prediction result.
 -  The encoding unit may encode information about the plurality of regions and information about the set weights.
 -  According to another aspect of the present invention, there is provided a video decoding method including receiving a bitstream including data about a residual block of a current block, extracting the data about the residual block, information about a plurality of motion vectors required for interprediction of the current block, information about a plurality of regions obtained by dividing the current block for the interprediction, and information about weights set independently for each of the regions from the received bitstream, predicting the plurality of regions using the information about the weights and a plurality of reference blocks selected based on the information about the plurality of motion vectors, and reconstructing the current block based on the prediction result and the data about the residual block.
 -  According to another aspect of the present invention, there is provided a video decoding apparatus including a decoding unit, a motion compensation unit, and a reconstruction unit. The decoding unit receives a bitstream including data about a residual block of a current block and extracts the data about the residual block, information about a plurality of motion vectors required for interprediction of the current block, information about a plurality of regions obtained by dividing the current block for the interprediction, and information about weights set independently for each of the regions from the received bitstream. The motion compensation unit predicts the plurality of regions using the information about the weights and a plurality of reference blocks selected based on the information about the plurality of motion vectors. The reconstruction unit reconstructs the current block based on the prediction result and the data about the residual block.
 -  According to another aspect of the present invention, there is provided a computer-readable recording medium having recorded thereon a program for executing the video encoding and decoding method.
 -  The above and other aspects of the present invention will become more apparent by describing in detail exemplary embodiments thereof with reference to the attached drawings in which:
 -  
FIG. 1 illustrates an example of weighted prediction according to the related art; -  
FIG. 2 is a block diagram of a video encoding apparatus according to an exemplary embodiment of the present invention; -  
FIGS. 3A and 3B illustrate a plurality of motion vectors according to an exemplary embodiment of the present invention; -  
FIG. 4 is a diagram for explaining weight prediction according to an exemplary embodiment of the present invention; -  
FIGS. 5A through 5D illustrate a plurality of weighting partitions according to an exemplary embodiment of the present invention; -  
FIG. 6 is a diagram for explaining weight prediction according to another exemplary embodiment of the present invention; -  
FIGS. 7A through 7C illustrate cutting points according to an exemplary embodiment of the present invention; -  
FIG. 8 is a block diagram of a video encoding apparatus according to another exemplary embodiment of the present invention; -  
FIG. 9 is a flowchart of a video encoding method according to an exemplary embodiment of the present invention; -  
FIG. 10 is a block diagram of a video decoding apparatus according to an exemplary embodiment of the present invention; and -  
FIG. 11 is a flowchart of a video decoding method according to an exemplary embodiment of the present invention. -  Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings. It should be noted that like reference numerals refer to like elements illustrated in one or more of the drawings. In the following description of the present invention, detailed description of known functions and configurations incorporated herein will be omitted for conciseness and clarity.
 -  
FIG. 2 is a block diagram of avideo encoding apparatus 200 according to an exemplary embodiment of the present invention. -  Referring to
FIG. 2 , thevideo encoding apparatus 200 according to the exemplary embodiment of the present invention includes amotion estimation unit 210, amotion compensation unit 220, and anencoding unit 230. -  The
motion estimation unit 210 estimates a plurality of motion vectors required for interprediction of a current block and selects a plurality of reference blocks based on the estimated motion vectors. According to an exemplary embodiment of the present invention, thevideo encoding apparatus 200 performs interprediction by setting weights to be assigned to the plurality of reference blocks, which are different from region to region. To this end, themotion estimation unit 210 first estimates the plurality of motion vectors required for interprediction of the current block. -  Although the plurality of motion vectors can be estimated in various ways, the plurality of motion vectors that help to predict the most approximate value for the current block using weighted prediction according to the present invention are calculated.
 -  For example, it is assumed that the current block is divided into M regions and there are N combinations of weights assigned to the plurality of reference blocks referred to by the current block. Since N combinations of weights are available for each of the M regions, M×N combinations of weights can be used for interprediction of the current block. The plurality of motion vectors are estimated for each of the M×N combinations. Based on the estimation result, one of the M×N combinations and corresponding motion vectors in which a residual block between the current block and a prediction block thereof is smallest are selected.
 -  To reduce the amount of calculation, an initial value may be set for the plurality of motion vectors and the optimal motion vector for each of the motion vectors may be estimated one-by-one. In this case, if the current block is estimated by two motion vectors MV0 and MV1, an initial value for the motion vectors MV0 and MV1 is set. The motion vector MV1 is fixed to the initial value and the optimal motion vector MV0 is estimated according to the M×N combinations described above. Next, the estimated optimal motion vector MV0 is fixed to MV0, and the optimal motion vector MV1 is estimated according to the M×N combinations described above.
 -  However, when the plurality of motion vectors are estimated according to various combinations of weights, the amount of calculation performed by the
video encoding apparatus 200 increases, resulting in a reduction in encoding speed. Thus, the plurality of motion vectors required for prediction of the current block can also be estimated as illustrated inFIGS. 3A and 3B . -  
FIGS. 3A and 3B illustrate a plurality of motion vectors for acurrent block 310, according to an exemplary embodiment of the present invention. -  Referring to
FIG. 3A , thecurrent block 310 includes sub-blocks 312 and 314. A motion vector is estimated for each of the sub-blocks 312 and 314 included in thecurrent block 310, and the estimated motion vectors may be used as the plurality of motion vectors for thecurrent block 310. -  For example, the
motion estimation unit 210 estimates a motion vector MV0 for the sub-block 312 located in an upper portion of thecurrent block 310. A block that is most similar to the sub-block 312 is searched for in at least one reference picture, and the motion vector MV0 for the sub-block 312 is estimated according to the search result. Next, a motion vector MV1 for the sub-block 314 located in a lower portion of thecurrent block 310 is estimated by searching the at least one reference picture. The motion vectors MV0 and MV1 for the sub-blocks 312 and 314 serve as the plurality of motion vectors required for interprediction of thecurrent block 310. -  
FIG. 3B is a diagram for explaining prediction of acurrent block 312 using bi-predictive prediction, according to an exemplary embodiment of the present invention. -  In
FIG. 3B , thecurrent block 312 is predicted from 322 and 332 included in a plurality ofblocks  320 and 330 that temporally precede or follow adifferent pictures current picture 310 similar to that as shown inFIG. 1 . Referring toFIG. 3B , thecurrent block 312 is predicted by referring to a plurality of reference blocks 322 and 332 included in the 320 and 330. Thedifferent pictures  322 and 332 that are most similar to theblocks current block 312 are searched for in the reference pictures 320 and 330, and the found 322 and 332 are referred to. In this case, motion vectors MV0 and MV 1 indicating the plurality of reference blocks 322 and 332 serve as a plurality of motion vectors required for interprediction of theblocks current block 312. -  Referring back to
FIG. 2 , after themotion estimation unit 210 estimates the plurality of motion vectors required for interprediction of the current block, themotion compensation unit 220 performs interprediction on the current block using the estimated motion vectors using weighted prediction according to an exemplary embodiment of the present invention. -  In other words, the current block is divided into a plurality of regions and weights assigned to a plurality of reference blocks are set independently for each of the regions for interprediction of the current block, as will be described in detail with reference to
FIG. 4 . -  
FIG. 4 is a diagram for explaining weighted prediction according to an exemplary embodiment of the present invention. -  In
FIG. 4 , weighted prediction is performed on the current block by referring to four different reference blocks. -  Referring to
FIG. 4 , themotion compensation unit 220 divides the current block into a plurality of regions in order to set aweighting partition 400. -  Upon selection of a plurality of
 410, 420, 430, and 440 to be used for prediction of the current block according to the plurality of motion vectors estimated by thereference pictures motion estimation unit 210, themotion compensation unit 220 multiplies the reference pictures 410, 420, 430, and 440 with theweighting partition 400. At this time, weights for the reference pictures 410, 420, 430, and 440 are set independently for each of a plurality of 402, 404, 406, and 408 included in theweighting regions weighting partition 400. -  For example, for the
weighting region 402 located in a left upper portion of theweighting partition 400, a weight of 0.2 is set for thereference picture 410, a weight of 0.4 is set for thereference picture 420, a weight of 0.1 is set for thereference picture 430, and a weight of 0.3 is set for thereference picture 440. -  The weights assigned to the reference pictures change from weighting region to weighting region, allowing flexible weighted prediction.
 412, 422, 432, and 442 generated by the multiplication are summed up, thereby generating aBlocks prediction block 450 of the current block. -  It can be easily known by those of ordinary skill in the art that a form in which the current block is divided into a plurality of regions by the
motion compensation unit 220 is not limited to an example illustrated inFIG. 4 . Representative examples for division of the current block will be described with reference toFIGS. 5A through 5D . -  Weights assigned to the reference pictures 410, 420, 430, and 440 are not also limited to the example illustrated in
FIG. 4 . In particular, infinite decimal fractions between 0 and 1 may be used as the weights. Thus, weight information about the weights can be efficiently encoded by limiting the number of weights that can be set, as will be described later with reference toFIG. 6 . -  
FIGS. 5A through 5D illustrate a plurality of weighting partitions according to an exemplary embodiment of the present invention. -  In
FIGS. 5A through 5D , themotion compensation unit 220 sets the weighting regions by dividing the current block for flexible weighted prediction. -  The current block is divided in a horizontal direction in
FIG. 5A , the current block is divided in a vertical directions inFIG. 5B , and the current block is divided in an oblique direction inFIG. 5C . InFIG. 5D , the current block is hierarchically divided into regular squares as in conventional video encoding. However, it can be easily understood by those of ordinary skill in the art that the current block can be divided in various other ways for setting a weighting partition without being limited to the weighting partitions illustrated inFIGS. 5A through 5D . -  
FIG. 6 is a diagram for explaining weighted prediction according to another exemplary embodiment of the present invention. -  In
FIG. 6 , themotion estimation unit 220 performs weighted prediction when a weighting partition is set as illustrated inFIG. 5A . In other words, the number of weighting regions of the weighting partition, i.e., NP, is equal to 4, and the number of weight interval between 0 and 1, i.e., NW, is equal to 3. -  Referring to
FIG. 6 , when acurrent block 600 is interpredicted based on tworeference blocks # 0 610 and #1 620, weights assigned to the reference blocks 610 and 620 are set independently for each of a plurality of 602, 604, 606, and 608. For example, a weight W0 is assigned to theweighting regions reference block 610 for theweighting region 602 located uppermost in thecurrent block 600, a weight W1 is assigned to thereference block 610 for theweighting region 604 located second from the top, a weight W2 is assigned to thereference block 610 for theweighting region 606 located third from the top, and a weight W3 is assigned to thereference block 610 for theweighting region 608 located lowermost in thecurrent block 600. Similarly, weights of (1-WN) are assigned to thereference block 620 in descending order from the top of thecurrent block 600. Here, N may be 0, 1, 2, and 3. Since only the two 610 and 620 are used, upon determination of the weights WN for one of the reference blocks, the weights (1-WN) for the other reference block can also be determined.reference blocks  -  For the number of weight interval NW=3, W0, W1, W2, W3 ∉ {0, ⅓, ⅔, 1}. By setting the number of weight interval, weights that can be assigned are limited to 0, ⅓, ⅔, and 1.
 -  Once the weights are assigned, the
motion compensation unit 220 predicts thecurrent block 600 according to the assigned weights. Theweighting region 602 located uppermost in thecurrent block 600 is predicted using corresponding regions of the reference blocks 610 and 620. When prediction values of the 602, 604, 606, and 608 are P0, P1, P2, and P3, respectively, they can be set according to the assigned weights, as follows.weighting regions  -  
P 0 =W 0 R 00+F1−W 0)R 10 -  
P 1 =W 1 R 01+(1−W 1)R 11 -  
P 2 =W 2 R 02+(1−W 2)R 12 -  
P 3 =W 3 R 03+(1−W 3)R 13 -  However, it can be easily understood by those of ordinary skill in the art that the
current block 600 can also be predicted by adding a predetermined offset value DN to P0, P1, P2, and P3. Here, N may be 0, 1, 2, and 3. -  The
encoding unit 230 encodes the current block based on the prediction result obtained by themotion compensation unit 220. Once a prediction block of the current block is generated by prediction of themotion compensation unit 220, theencoding unit 230 generates a residual block by subtracting the prediction block from the current block. Theencoding unit 230 then performs a Discrete Cosine Transform (DCT) on the residual block and quantizes coefficients resulting from the DCT. Theencoding unit 230 performs entropy-coding on the quantized coefficients, thereby generating a bitstream. During encoding, theencoding unit 230 also encodes weighting partition information and weight information and inserts the encoded information into the bitstream. -  The weighting partition information indicates how the current block is divided into a plurality of regions and the weight information indicates weights assigned to reference blocks, which are set independently for each of the regions.
 -  When the current block is divided into regions of the same size as illustrated in
FIGS. 5A and 5B , only information about a dividing direction (a horizontal direction or a vertical direction) and the number of regions are encoded as the weighting partition information and a decoding side can perform decoding by referring to the weighting partition information. -  However, when weighted prediction has been performed on the current block divided in an arbitrary direction as illustrated in
FIG. 5C , the decoding side cannot perform weighted prediction on the current block by using only the information including the dividing direction and the number of regions. Thus, it is necessary to encode the weight partition information in another way, as will be described in detail with reference toFIGS. 7A through 7C . -  
FIGS. 7A through 7C illustrate cutting points according to an exemplary embodiment of the present invention. -  When a
current block 700 is divided into regions of different sizes for weighted prediction as illustrated inFIGS. 7A and 7B , a decoding side cannot accurately specify a way to divide thecurrent block 700 by using only information about a dividing direction (a horizontal direction or a vertical direction) and the number of regions. Thus, in this case, theencoding unit 230 also encodes information about the dividing shape. For example, a cutting point according to the boundary of a region, i.e., information aboutvertical coordinates 710 orhorizontal coordinates 720 at which a 702 or 704 of a region intersects a boundary of theboundary current block 700, is encoded and then inserted into a bitstream. -  When the
current block 700 is divided in an arbitrary direction instead of the horizontal or vertical direction, information abouthorizontal coordinates 730 andvertical coordinates 732 at which aboundary 706 of a region intersects the boundary of thecurrent block 700 is encoded and then inserted into a bitstream. -  
FIG. 8 is a block diagram of avideo encoding apparatus 800 according to another exemplary embodiment of the present invention. -  Referring to
FIG. 8 , thevideo encoding apparatus 800 according to the exemplary embodiment of the present invention includes amotion estimation unit 810, amotion compensation unit 820, asubtraction unit 830, anencoding unit 840, adecoding unit 850, areconstruction unit 860, and apicture memory 870. -  The
motion estimation unit 810 searches reference pictures stored in thepicture memory 870 in order to estimate a plurality of motion vectors required for interprediction of a current block. Themotion estimation unit 810 estimates a plurality of motion vectors that help to predict the most approximate value for the current block by searching the reference pictures when weighted prediction according to the present invention is performed. -  The
motion estimation unit 810 may also estimate a motion vector for each sub-block included in the current block and use the estimated motion vectors as motion vectors required for interprediction of the current block as in the prior art. In this case, themotion estimation unit 810 searches in a reference picture for a block that is most similar to each sub-block and estimates the motion vector for each sub-block. -  The
motion estimation unit 810 may also estimate the motion vectors for the current block using bi-predictive prediction. Reference blocks corresponding to the current block are selected by searching a plurality of different pictures that temporally precede or follow the current block, thereby estimating the motion vectors for the current block. -  The
motion compensation unit 820 interpredicts the current block using the plurality of motion vectors estimated by themotion estimation unit 810. In other words, themotion compensation unit 820 interpredicts the current block using flexible weighted prediction described above withreference 10FIGS. 4 and 6 . -  The
subtraction unit 830 subtracts a prediction block generated by interprediction of themotion compensation unit 820 from the current block, thereby generating a residual block. -  The
encoding unit 840 encodes the residual block generated by thesubtraction unit 830. More specifically, theencoding unit 840 performs DCT on the residual block in order to generate DCT coefficients and quantizes the generated DCT coefficients. Theencoding unit 840 then performs entropy-coding on the quantized DCT coefficients, thereby generating a bitstream. -  The
decoding unit 850 decodes the residual block encoded by theencoding unit 840, thereby reconstructing the residual block. More specifically, thedecoding unit 850 performs inverse quantization and inverse DCT on the encoded residual block, thereby reconstructing the residual block. -  The
reconstruction unit 860 adds the prediction block generated by themotion compensation unit 820 to the residual block reconstructed by thedecoding unit 850, thereby reconstructing the current block. The reconstructed current block is stored in thepicture memory 870 for use in prediction of a next block or a next picture. -  
FIG. 9 is a flowchart of a video encoding method according to an exemplary embodiment of the present invention. -  In
operation 910, a video encoding apparatus estimates a plurality of motion vectors required for interprediction of a current block and selects a plurality of reference blocks based on the estimated motion vectors. As mentioned previously, there is no limit to a way of estimating the plurality of motion vectors, and motion vectors that guarantee the best performance of prediction for the current block using flexible weighted prediction may be estimated or motion vector estimation according to the related art may be used. When motion vector estimation according to the related art is used, motion vectors for sub-blocks included in the current block may be used as the motion vectors for the current block, or the motion vectors for the current block may be estimated by searching pictures that temporally precede or follow the current block using bi-predictive prediction. -  In
operation 920, the video encoding apparatus divides the current block into a plurality of regions and sets weights assigned to the selected reference blocks independently for each of the regions. -  In
operation 930, the video encoding apparatus predicts the current block from the plurality of reference blocks based on the setting result ofoperation 920. As discussed above with reference toFIGS. 4 and 6 , weighted prediction is performed using different weight combinations for different regions of the current block, thereby accurately predicting the current block. -  In
operation 940, the video encoding apparatus encodes the current block based on the prediction result ofoperation 930. A prediction block generated by the prediction is subtracted from the current block, thereby generating a residual block. DCT is performed on the generated residual block, thereby generating DCT coefficients. The generated DCT coefficients are quantized and entropy-coded, and then inserted into a bitstream. -  
FIG. 10 is a block diagram of avideo decoding apparatus 1000 according to an exemplary embodiment of the present invention. -  Referring to
FIG. 10 , thevideo decoding apparatus 1000 according to the exemplary embodiment of the present invention includes adecoding unit 1010, amotion compensation unit 1020, areconstruction unit 1030, and apicture memory 1040. -  The
decoding unit 1010 receives a bitstream including data about a residual block of a current block. Thedecoding unit 1010 extracts the data about the residual block, information about a plurality of motion vectors required for prediction of the current block, information about a weighting partition including a plurality of regions for weighted prediction of the current block, and information about weights set independently for each of the regions from the received bitstream. -  The
decoding unit 1010 performs entropy-decoding and inverse quantization on the extracted data about the residual block, thereby generating DCT coefficients. Thedecoding unit 1010 performs inverse DCT on the generated DCT coefficients, thereby reconstructing a residual block. -  Information about a weighting partition including the plurality of regions may indicate the number of regions as described regarding the
encoding unit 230 or a cutting point at which the boundary of a region intersects the boundary of the current block as described with reference toFIGS. 7A and 7B . -  The
motion compensation unit 1020 interpredicts the current block based on the data extracted by thedecoding unit 1010. Themotion compensation unit 1020 performs flexible weighted prediction described above with reference toFIGS. 4 and 6 . -  The
motion compensation unit 1020 searches reference pictures stored in thepicture memory 1040 based on the plurality of motion vectors extracted by thedecoding unit 1010 and selects a plurality of reference blocks for interprediction of the current block. The plurality of reference blocks may be selected from a single picture or a plurality of pictures that temporally precede or follow the current block. -  The
motion compensation unit 1020 then performs flexible weighted prediction using the selected reference blocks. Themotion compensation unit 1020 interpredicts the current block based on the information about the weighting partition including the plurality of regions of the current block divided for interprediction and the information about weights set independently for each of the regions. In other words, themotion compensation unit 1020 divides the current block into a plurality of regions based on the information about the weighting partition extracted by thedecoding unit 1010 and assigns the weights set independently for each of the regions to the reference blocks, thereby performing weighted prediction on the current block. -  The
reconstruction unit 1030 reconstructs the current block based on a prediction block generated by the prediction of themotion compensation unit 1020 and the residual block decoded by thedecoding unit 1010. More specifically, thereconstruction unit 1030 adds the prediction block to the residual block, thereby reconstructing the current block. -  The reconstructed current block is stored in the
picture memory 1040 for use in prediction of a next block or a next picture. -  
FIG. 11 is a flowchart of a video decoding method according to an exemplary embodiment of the present invention. -  Referring to
FIG. 11 , a video decoding apparatus receives a bitstream including data about a residual block of a current block inoperation 1110. -  In
operation 1120, the video decoding apparatus extracts the data about the residual block, information about a plurality of motion vectors required for prediction of the current block, information about a weighting partition including a plurality of regions for weighted prediction of the current block, and information about weights set independently for each of the regions from the bitstream received inoperation 1110. The video decoding apparatus reconstructs the data about the residual block by performing entropy decoding, inverse quantization, and inverse DCT. -  In
operation 1130, the video decoding apparatus interpredicts the current block based on the information extracted inoperation 1120. More specifically, the video decoding apparatus selects a plurality of reference blocks required for interprediction of the current block based on the extracted information about the plurality of motion vectors and performs weighted prediction by setting weights assigned to the plurality of reference blocks independently for each of the regions. -  In
operation 1140, the video decoding apparatus reconstructs the current block based on a prediction block generated by the prediction ofoperation 1130 and the residual block reconstructed inoperation 1120. More specifically, the video decoding apparatus reconstructs the current block by adding the prediction block to the residual block. -  As described above, according to the exemplary embodiments of the present invention, a current block can be accurately interpredicted during video encoding and decoding, thereby improving the compression rate of video encoding.
 -  Moreover, regions obtained by dividing the current block can be predicted using different weight combinations, thereby making flexible weighted prediction possible.
 -  Meanwhile, the exemplary embodiments of the present invention can be written as computer programs and can be implemented in general-use digital computers that execute the programs using a computer readable recording medium. Examples of the computer readable recording medium include magnetic storage media (e.g., ROM, floppy disks, hard disks, etc.), and optical recording media (e.g., CD-ROMs, or DVDs). The computer readable recording medium can also be distributed over network coupled computer systems so that the computer readable code is stored and executed in a distributed fashion.
 -  While the present invention has been particularly shown and described with reference to exemplary embodiments thereof, it will be understood by those of ordinary skill in the art that various changes in form and detail may be made therein without departing from the spirit and scope of the present invention as defined by the following claims.
 
Claims (15)
 1. A video encoding method comprising:
    estimating a plurality of motion vectors for interprediction of a current block;
 selecting a plurality of reference blocks based on the plurality of estimated motion vectors;
 dividing a current block into a plurality of regions and setting weights assigned to the plurality of reference blocks for interprediction independently for each of the regions;
 predicting the current block from the plurality of reference blocks based on the set weights; and
 encoding the current block based on a result of the prediction.
  2. The video encoding method of claim 1 , wherein the plurality of motion vectors are motion vectors for a plurality of sub-blocks included in the current block, and each of the reference blocks and the current block have a same size.
     3. The video encoding method of claim 1 , wherein the plurality of motion vectors are motion vectors for bi-predictive prediction of the current block, and each of the reference blocks and the current block have a same size.
     4. The video encoding method of claim 1 , wherein the encoding the current block comprises encoding information about the plurality of regions and information about the set weights.
     5. The video encoding method of claim 1 , wherein the plurality of regions are generated by dividing the current block in a horizontal direction or a vertical direction.
     6. The video encoding method of claim 1 , wherein the plurality of regions are generated by dividing the current block in a direction, and the encoding of the current block comprises encoding information about the direction used in dividing the current block.
     7. The video encoding method of claim 6 , wherein the information about the direction indicates horizontal coordinates and vertical coordinates at which a boundary of one of the regions according to the direction intersects a boundary of the current block.
     8. A video encoding apparatus comprising:
    a motion estimation unit which estimates a plurality of motion vectors for interprediction of a current block and selects a plurality of reference blocks based on the plurality of estimated motion vectors;
 a motion compensation unit which divides a current block into a plurality of regions, sets weights assigned to the plurality of reference blocks for interprediction independently for each of the regions, and predicts the current block from the plurality of reference blocks based on the set weights, to generate a prediction result; and
 an encoding unit which encodes the current block based on the prediction result.
  9. The video encoding apparatus of claim 8 , wherein the plurality of motion vectors are motion vectors for a plurality of sub-blocks included in the current block, and each of the reference blocks and the current block have a same size.
     10. The video encoding apparatus of claim 8 , wherein the plurality of motion vectors are motion vectors for bi-predictive prediction of the current block, and each of the reference blocks and the current block have a same size.
     11. The video encoding apparatus of claim 8 , wherein the encoding unit encodes information about the plurality of regions and information about the set weights.
     12. The video encoding apparatus of claim 8 , wherein the plurality of regions are generated by dividing the current block in a horizontal direction or a vertical direction.
     13. The video encoding apparatus of claim 8 , wherein the plurality of regions are generated by dividing the current block in a direction, and the encoding unit encodes information about the direction used in dividing the current block.
     14. The video encoding apparatus of claim 13 , wherein the information about the direction indicates horizontal coordinates and vertical coordinates at which a boundary of one of the regions according to the direction intersects a boundary of the current block.
     15. A computer-readable recording medium having recorded thereon a program for executing a video encoding method comprising:
    estimating a plurality of motion vectors for interprediction of a current block;
 selecting a plurality of reference blocks based on the plurality of estimated motion vectors;
 dividing a current block into a plurality of regions and setting weights assigned to the plurality of reference blocks for interprediction independently for each of the regions;
 predicting the current block from the plurality of reference blocks based on the set weights; and
 encoding the current block based on a result of the predicting. 
 Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title | 
|---|---|---|---|
| US13/482,364 US20120236943A1 (en) | 2007-07-31 | 2012-05-29 | Video encoding and decoding method and apparatus using weighted prediction | 
Applications Claiming Priority (4)
| Application Number | Priority Date | Filing Date | Title | 
|---|---|---|---|
| KR10-2007-0077164 | 2007-07-31 | ||
| KR20070077164A KR101408698B1 (en) | 2007-07-31 | 2007-07-31 | Image encoding and decoding method and apparatus using weight prediction | 
| US12/132,637 US8208557B2 (en) | 2007-07-31 | 2008-06-04 | Video encoding and decoding method and apparatus using weighted prediction | 
| US13/482,364 US20120236943A1 (en) | 2007-07-31 | 2012-05-29 | Video encoding and decoding method and apparatus using weighted prediction | 
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date | 
|---|---|---|---|
| US12/132,637 Division US8208557B2 (en) | 2007-07-31 | 2008-06-04 | Video encoding and decoding method and apparatus using weighted prediction | 
Publications (1)
| Publication Number | Publication Date | 
|---|---|
| US20120236943A1 true US20120236943A1 (en) | 2012-09-20 | 
Family
ID=40304510
Family Applications (2)
| Application Number | Title | Priority Date | Filing Date | 
|---|---|---|---|
| US12/132,637 Active 2031-04-27 US8208557B2 (en) | 2007-07-31 | 2008-06-04 | Video encoding and decoding method and apparatus using weighted prediction | 
| US13/482,364 Abandoned US20120236943A1 (en) | 2007-07-31 | 2012-05-29 | Video encoding and decoding method and apparatus using weighted prediction | 
Family Applications Before (1)
| Application Number | Title | Priority Date | Filing Date | 
|---|---|---|---|
| US12/132,637 Active 2031-04-27 US8208557B2 (en) | 2007-07-31 | 2008-06-04 | Video encoding and decoding method and apparatus using weighted prediction | 
Country Status (6)
| Country | Link | 
|---|---|
| US (2) | US8208557B2 (en) | 
| JP (1) | JP5073824B2 (en) | 
| KR (1) | KR101408698B1 (en) | 
| CN (1) | CN101766030B (en) | 
| MY (1) | MY158765A (en) | 
| WO (1) | WO2009017301A1 (en) | 
Cited By (7)
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| US20190306512A1 (en) * | 2018-03-30 | 2019-10-03 | Hulu, LLC | Template Based Adaptive Weighted Bi-Prediction For Video Coding | 
| US10939125B2 (en) | 2016-04-29 | 2021-03-02 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US11159793B2 (en) | 2017-10-16 | 2021-10-26 | Digitalinsights Inc. | Method, device, and recording medium storing bit stream, for encoding/decoding image | 
| US20220272361A1 (en) * | 2016-04-29 | 2022-08-25 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US11563952B2 (en) | 2016-07-14 | 2023-01-24 | Samsung Electronics Co., Ltd. | Video decoding method and device therefor, and video encoding method and device therefor | 
| US12063352B2 (en) | 2019-06-28 | 2024-08-13 | Sk Telecom Co., Ltd. | Method for deriving bidirectional prediction weight index and video decoding apparatus | 
| US12184881B2 (en) | 2016-07-05 | 2024-12-31 | Kt Corporation | Method and apparatus for processing video signal | 
Families Citing this family (64)
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| TWI257817B (en) * | 2005-03-08 | 2006-07-01 | Realtek Semiconductor Corp | Method and apparatus for loading image data | 
| KR101377660B1 (en) * | 2008-09-30 | 2014-03-26 | 에스케이텔레콤 주식회사 | Motion Vector Encoding/Decoding Method and Apparatus Using Multiple Motion Vector Estimation and Video Encoding/Decoding Method and Apparatus Using Same | 
| KR101377527B1 (en) * | 2008-10-14 | 2014-03-25 | 에스케이 텔레콤주식회사 | Method and Apparatus for Encoding and Decoding Motion Vector in Plural Number of Reference Pictures and Video Encoding/Decoding Method and Apparatus Using Same | 
| PT3567853T (en) | 2009-03-23 | 2023-12-19 | Ntt Docomo Inc | PREDICTIVE IMAGE DECODING DEVICE AND A PREDICTIVE IMAGE DECODING METHOD | 
| CN102883160B (en) | 2009-06-26 | 2016-06-29 | 华为技术有限公司 | Video image motion information getting method, device and equipment, template construction method | 
| US9161057B2 (en) | 2009-07-09 | 2015-10-13 | Qualcomm Incorporated | Non-zero rounding and prediction mode selection techniques in video encoding | 
| US8995526B2 (en) | 2009-07-09 | 2015-03-31 | Qualcomm Incorporated | Different weights for uni-directional prediction and bi-directional prediction in video coding | 
| WO2011019384A1 (en) * | 2009-08-11 | 2011-02-17 | Thomson Licensing | Methods and apparatus for generalized weighted prediction | 
| EP2302933A1 (en) * | 2009-09-17 | 2011-03-30 | Mitsubishi Electric R&D Centre Europe B.V. | Weighted motion compensation of video | 
| ES2554237T3 (en) * | 2009-10-01 | 2015-12-17 | Sk Telecom. Co., Ltd. | Method and apparatus for encoding / decoding image using a split layer | 
| WO2011050641A1 (en) * | 2009-10-28 | 2011-05-05 | Mediatek Singapore Pte. Ltd. | Video coding methods and video encoders and decoders with localized weighted prediction | 
| US9036692B2 (en) * | 2010-01-18 | 2015-05-19 | Mediatek Inc. | Motion prediction method | 
| US9161058B2 (en) * | 2010-03-27 | 2015-10-13 | Texas Instruments Incorporated | Method and system for detecting global brightness change for weighted prediction in video encoding | 
| EP2375754A1 (en) * | 2010-04-09 | 2011-10-12 | Mitsubishi Electric R&D Centre Europe B.V. | Weighted motion compensation of video | 
| US8619857B2 (en) | 2010-04-09 | 2013-12-31 | Sharp Laboratories Of America, Inc. | Methods and systems for intra prediction | 
| US8644375B2 (en) | 2010-04-09 | 2014-02-04 | Sharp Laboratories Of America, Inc. | Methods and systems for intra prediction | 
| US20110249741A1 (en) * | 2010-04-09 | 2011-10-13 | Jie Zhao | Methods and Systems for Intra Prediction | 
| WO2011149291A2 (en) * | 2010-05-26 | 2011-12-01 | 엘지전자 주식회사 | Method and apparatus for processing a video signal | 
| US8908755B2 (en) | 2010-07-16 | 2014-12-09 | Sony Corporation | Multi-parameter motion for efficient prediction in video compression | 
| WO2012011432A1 (en) | 2010-07-20 | 2012-01-26 | 株式会社エヌ・ティ・ティ・ドコモ | Image prediction encoding device, image prediction encoding method, image prediction encoding program, image prediction decoding device, image prediction decoding method, and image prediction decoding program | 
| US20120029048A1 (en) * | 2010-07-30 | 2012-02-02 | Via Pharmaceuticals, Inc. | Phenylalkyl n-hydroxyureas for treating leukotriene related pathologies | 
| EP2630801A4 (en) * | 2010-10-18 | 2015-08-12 | Thomson Licensing | METHOD AND DEVICE FOR AUTOMATICALLY PREDICTING A VALUE ASSOCIATED WITH A DATA TUPLE | 
| US9521424B1 (en) * | 2010-10-29 | 2016-12-13 | Qualcomm Technologies, Inc. | Method, apparatus, and manufacture for local weighted prediction coefficients estimation for video encoding | 
| EP3930330B1 (en) | 2011-06-16 | 2023-06-07 | GE Video Compression, LLC | Entropy coding of motion vector differences | 
| CN102843561B (en) * | 2011-06-21 | 2017-03-08 | 乐金电子(中国)研究开发中心有限公司 | Inter frame image predicts reference frame number decoding method and the codec of encoding and decoding | 
| WO2012174840A1 (en) * | 2011-06-21 | 2012-12-27 | Lg Electronics(China) R&D Center Co., Ltd | Inter picture prediction encoding/decoding and method and apparatus for reference frame serial number encoding/decoding thereof | 
| KR101444675B1 (en) * | 2011-07-01 | 2014-10-01 | 에스케이 텔레콤주식회사 | Method and Apparatus for Encoding and Decoding Video | 
| UA114674C2 (en) | 2011-07-15 | 2017-07-10 | ДЖ.І. ВІДІЕУ КЕМПРЕШН, ЛЛСі | CONTEXT INITIALIZATION IN ENTHROPIC CODING | 
| WO2013028121A1 (en) * | 2011-08-25 | 2013-02-28 | Telefonaktiebolaget L M Ericsson (Publ) | Depth map encoding and decoding | 
| US9300933B2 (en) * | 2013-06-07 | 2016-03-29 | Nvidia Corporation | Predictive enhancement of a portion of video data rendered on a display unit associated with a data processing device | 
| US10015515B2 (en) * | 2013-06-21 | 2018-07-03 | Qualcomm Incorporated | Intra prediction from a predictive block | 
| CN104427345B (en) * | 2013-09-11 | 2019-01-08 | 华为技术有限公司 | Acquisition methods, acquisition device, Video Codec and its method of motion vector | 
| US9883197B2 (en) | 2014-01-09 | 2018-01-30 | Qualcomm Incorporated | Intra prediction of chroma blocks using the same vector | 
| FR3029055B1 (en) * | 2014-11-24 | 2017-01-13 | Ateme | IMAGE ENCODING METHOD AND EQUIPMENT FOR IMPLEMENTING THE METHOD | 
| WO2017086738A1 (en) | 2015-11-19 | 2017-05-26 | 한국전자통신연구원 | Method and apparatus for image encoding/decoding | 
| KR20170058838A (en) | 2015-11-19 | 2017-05-29 | 한국전자통신연구원 | Method and apparatus for encoding/decoding of improved inter prediction | 
| CN105681809B (en) * | 2016-02-18 | 2019-05-21 | 北京大学 | For the motion compensation process of double forward prediction units | 
| KR102833523B1 (en) * | 2016-05-03 | 2025-07-15 | 코닌클리케 필립스 엔.브이. | Method and apparatus for in-loop filter of virtual block | 
| EP4072141A1 (en) | 2016-03-24 | 2022-10-12 | Intellectual Discovery Co., Ltd. | Method and apparatus for encoding/decoding video signal | 
| KR102431287B1 (en) * | 2016-04-29 | 2022-08-10 | 세종대학교산학협력단 | Method and apparatus for encoding/decoding a video signal | 
| KR102425722B1 (en) * | 2016-04-29 | 2022-07-27 | 세종대학교산학협력단 | Method and apparatus for encoding/decoding a video signal | 
| KR102557740B1 (en) * | 2016-04-29 | 2023-07-24 | 세종대학교산학협력단 | Method and apparatus for encoding/decoding a video signal | 
| KR102557797B1 (en) * | 2016-04-29 | 2023-07-21 | 세종대학교산학협력단 | Method and apparatus for encoding/decoding a video signal | 
| CN109496430B (en) * | 2016-05-13 | 2022-06-14 | Vid拓展公司 | System and method for generalized multi-hypothesis prediction for video coding | 
| ES2737843B2 (en) * | 2016-07-05 | 2021-07-15 | Kt Corp | METHOD AND APPARATUS TO PROCESS A VIDEO SIGNAL | 
| WO2018008906A1 (en) * | 2016-07-05 | 2018-01-11 | 주식회사 케이티 | Method and apparatus for processing video signal | 
| CN110024402B (en) * | 2016-11-29 | 2023-08-22 | 韩国电子通信研究院 | Image encoding/decoding method and apparatus, and recording medium storing bit stream | 
| WO2019074985A1 (en) * | 2017-10-09 | 2019-04-18 | Arris Enterprises Llc | Adaptive unequal weight planar prediction | 
| CN113923455B (en) * | 2018-03-30 | 2023-07-18 | 华为技术有限公司 | A bidirectional inter-frame prediction method and device | 
| WO2019212223A1 (en) * | 2018-05-03 | 2019-11-07 | 엘지전자 주식회사 | Image decoding method using dmvr in image coding system and device therefor | 
| WO2019229683A1 (en) | 2018-05-31 | 2019-12-05 | Beijing Bytedance Network Technology Co., Ltd. | Concept of interweaved prediction | 
| CN110876063B (en) * | 2018-09-03 | 2023-01-31 | 北京字节跳动网络技术有限公司 | A Fast Coding Method for Interleaved Prediction | 
| TWI850252B (en) * | 2018-09-03 | 2024-08-01 | 大陸商北京字節跳動網絡技術有限公司 | Partial interweaved prediction | 
| WO2020103936A1 (en) * | 2018-11-22 | 2020-05-28 | Beijing Bytedance Network Technology Co., Ltd. | Pruning method for inter prediction with geometry partition | 
| CN113454999B (en) | 2019-01-02 | 2024-07-02 | 北京字节跳动网络技术有限公司 | Motion vector derivation between partition modes | 
| CN120730061A (en) * | 2019-06-12 | 2025-09-30 | 交互数字Vc控股公司 | Methods, apparatus, and products for video encoding and decoding | 
| CN118890467A (en) * | 2019-07-05 | 2024-11-01 | Lg电子株式会社 | Encoding/decoding equipment and equipment for sending data | 
| CN114342377B (en) * | 2019-07-05 | 2024-11-19 | Lg电子株式会社 | Image encoding/decoding method and apparatus for performing bidirectional prediction and method for transmitting bit stream | 
| WO2021006575A1 (en) * | 2019-07-05 | 2021-01-14 | 엘지전자 주식회사 | Image encoding/decoding method and device for deriving weight index of bidirectional prediction, and method for transmitting bitstream | 
| KR20220049554A (en) * | 2019-09-16 | 2022-04-21 | 엘지전자 주식회사 | Image encoding/decoding method using weighted prediction, apparatus, and method of transmitting a bitstream | 
| CN110826496B (en) * | 2019-11-07 | 2023-04-07 | 腾讯科技(深圳)有限公司 | Crowd density estimation method, device, equipment and storage medium | 
| WO2022117030A1 (en) | 2020-12-02 | 2022-06-09 | Zhejiang Dahua Technology Co., Ltd. | Systems and method for inter prediction based on a merge mode | 
| CN115567714B (en) * | 2020-12-02 | 2025-03-21 | 浙江大华技术股份有限公司 | Inter-frame prediction method, video encoding method and related device | 
| WO2024212255A1 (en) * | 2023-04-14 | 2024-10-17 | Oppo广东移动通信有限公司 | Encoding/decoding method, code stream, encoder, decoder, and storage medium | 
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| US20040101059A1 (en) * | 2002-11-21 | 2004-05-27 | Anthony Joch | Low-complexity deblocking filter | 
| US20050281334A1 (en) * | 2004-05-04 | 2005-12-22 | Qualcomm Incorporated | Method and apparatus for weighted prediction in predictive frames | 
| US20090196342A1 (en) * | 2006-08-02 | 2009-08-06 | Oscar Divorra Escoda | Adaptive Geometric Partitioning For Video Encoding | 
Family Cites Families (11)
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| US5398072A (en) * | 1993-10-25 | 1995-03-14 | Lsi Logic Corporation | Management of channel buffer in video decoders | 
| KR0178231B1 (en) | 1995-08-10 | 1999-05-01 | 배순훈 | Method and apparatus for detecting motion vectors based on hierarchical motion estimation | 
| JP3951321B2 (en) | 1995-08-30 | 2007-08-01 | ソニー株式会社 | Image signal processing apparatus and recording / reproducing apparatus | 
| JP3844844B2 (en) * | 1997-06-06 | 2006-11-15 | 富士通株式会社 | Moving picture coding apparatus and moving picture coding method | 
| US6157396A (en) * | 1999-02-16 | 2000-12-05 | Pixonics Llc | System and method for using bitstream information to process images for use in digital display systems | 
| KR20050075483A (en) * | 2004-01-15 | 2005-07-21 | 삼성전자주식회사 | Method for video coding and decoding, and apparatus for the same | 
| US20060146932A1 (en) * | 2004-12-30 | 2006-07-06 | Krit Panusopone | Method and apparatus for providing motion estimation with weight prediction | 
| US8457203B2 (en) | 2005-05-26 | 2013-06-04 | Ntt Docomo, Inc. | Method and apparatus for coding motion and prediction weighting parameters | 
| KR100750136B1 (en) * | 2005-11-02 | 2007-08-21 | 삼성전자주식회사 | Image encoding and decoding method and apparatus | 
| KR101375669B1 (en) * | 2006-11-07 | 2014-03-19 | 삼성전자주식회사 | Method and apparatus for encoding/decoding image base on inter prediction | 
| CN101669367A (en) * | 2007-03-02 | 2010-03-10 | Lg电子株式会社 | A method and an apparatus for decoding/encoding a video signal | 
- 
        2007
        
- 2007-07-31 KR KR20070077164A patent/KR101408698B1/en not_active Expired - Fee Related
 
 - 
        2008
        
- 2008-06-04 WO PCT/KR2008/003108 patent/WO2009017301A1/en not_active Ceased
 - 2008-06-04 CN CN2008801012507A patent/CN101766030B/en not_active Expired - Fee Related
 - 2008-06-04 JP JP2010519139A patent/JP5073824B2/en not_active Expired - Fee Related
 - 2008-06-04 US US12/132,637 patent/US8208557B2/en active Active
 - 2008-06-04 MY MYPI2010000483A patent/MY158765A/en unknown
 
 - 
        2012
        
- 2012-05-29 US US13/482,364 patent/US20120236943A1/en not_active Abandoned
 
 
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| US20040101059A1 (en) * | 2002-11-21 | 2004-05-27 | Anthony Joch | Low-complexity deblocking filter | 
| US20050281334A1 (en) * | 2004-05-04 | 2005-12-22 | Qualcomm Incorporated | Method and apparatus for weighted prediction in predictive frames | 
| US20090196342A1 (en) * | 2006-08-02 | 2009-08-06 | Oscar Divorra Escoda | Adaptive Geometric Partitioning For Video Encoding | 
Cited By (24)
| Publication number | Priority date | Publication date | Assignee | Title | 
|---|---|---|---|---|
| US12126818B2 (en) | 2016-04-29 | 2024-10-22 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US12137232B2 (en) | 2016-04-29 | 2024-11-05 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US12231657B2 (en) | 2016-04-29 | 2025-02-18 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signals using weight prediction parameter sets based on neighboring regions to obtain a residual block | 
| US10939125B2 (en) | 2016-04-29 | 2021-03-02 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US11909990B2 (en) | 2016-04-29 | 2024-02-20 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signals using weight prediction parameter sets based on neighboring regions | 
| US11876983B2 (en) | 2016-04-29 | 2024-01-16 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signals using weight prediction parameter sets based on size of current block | 
| US11750823B2 (en) * | 2016-04-29 | 2023-09-05 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US11363280B2 (en) | 2016-04-29 | 2022-06-14 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US20220272361A1 (en) * | 2016-04-29 | 2022-08-25 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US12028532B2 (en) | 2016-04-29 | 2024-07-02 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signals using weight prediction parameters | 
| US11856208B1 (en) | 2016-04-29 | 2023-12-26 | Industry Academy Cooperation Foundation Of Sejong University | Method and apparatus for encoding/decoding image signal | 
| US12184881B2 (en) | 2016-07-05 | 2024-12-31 | Kt Corporation | Method and apparatus for processing video signal | 
| US11909986B2 (en) | 2016-07-14 | 2024-02-20 | Samsung Electronics Co., Ltd. | Video decoding method and device therefor, and video encoding method and device therefor | 
| US11563952B2 (en) | 2016-07-14 | 2023-01-24 | Samsung Electronics Co., Ltd. | Video decoding method and device therefor, and video encoding method and device therefor | 
| US12160590B2 (en) | 2016-07-14 | 2024-12-03 | Samsung Electronics Co., Ltd. | Video decoding method and device therefor, and video encoding method and device therefor | 
| US11831870B2 (en) | 2017-10-16 | 2023-11-28 | Digitalinsights Inc. | Method, device, and recording medium storing bit stream, for encoding/decoding image | 
| US11265543B2 (en) | 2017-10-16 | 2022-03-01 | Digitalinsights Inc. | Method, device, and recording medium storing bit stream, for encoding/decoding image | 
| US11159793B2 (en) | 2017-10-16 | 2021-10-26 | Digitalinsights Inc. | Method, device, and recording medium storing bit stream, for encoding/decoding image | 
| US12439043B2 (en) | 2017-10-16 | 2025-10-07 | Digitalinsights Inc. | Method, device, and recording medium storing bit stream, for encoding/decoding image | 
| US20190306512A1 (en) * | 2018-03-30 | 2019-10-03 | Hulu, LLC | Template Based Adaptive Weighted Bi-Prediction For Video Coding | 
| WO2019191714A1 (en) | 2018-03-30 | 2019-10-03 | Hulu, LLC | Template based adaptive weighted bi-prediction for video coding | 
| EP3777174A4 (en) * | 2018-03-30 | 2021-12-22 | Hulu, LLC | TEMPLATE-BASED ADAPTIVE WEIGHTED BI-PRDICTION FOR VIDEO ENCODING | 
| US10869042B2 (en) * | 2018-03-30 | 2020-12-15 | Hulu, LLC | Template based adaptive weighted bi-prediction for video coding | 
| US12063352B2 (en) | 2019-06-28 | 2024-08-13 | Sk Telecom Co., Ltd. | Method for deriving bidirectional prediction weight index and video decoding apparatus | 
Also Published As
| Publication number | Publication date | 
|---|---|
| MY158765A (en) | 2016-11-15 | 
| WO2009017301A1 (en) | 2009-02-05 | 
| JP5073824B2 (en) | 2012-11-14 | 
| CN101766030A (en) | 2010-06-30 | 
| US20090034854A1 (en) | 2009-02-05 | 
| US8208557B2 (en) | 2012-06-26 | 
| JP2010535447A (en) | 2010-11-18 | 
| KR20090012926A (en) | 2009-02-04 | 
| CN101766030B (en) | 2013-03-13 | 
| KR101408698B1 (en) | 2014-06-18 | 
Similar Documents
| Publication | Publication Date | Title | 
|---|---|---|
| US8208557B2 (en) | Video encoding and decoding method and apparatus using weighted prediction | |
| CN107087165B (en) | Method and apparatus for video encoding and decoding | |
| CN103748880B (en) | Image sequence encoding method and device and image sequence decoding method and device | |
| US9369731B2 (en) | Method and apparatus for estimating motion vector using plurality of motion vector predictors, encoder, decoder, and decoding method | |
| CN107483958B (en) | Encoding method, encoding device, decoding method, and decoding device | |
| US20080304569A1 (en) | Method and apparatus for encoding and decoding image using object boundary based partition | 
Legal Events
| Date | Code | Title | Description | 
|---|---|---|---|
| STCB | Information on status: application discontinuation | 
             Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION  |