US12003753B2 - Method and apparatus for encoding/decoding images using a motion vector - Google Patents
Method and apparatus for encoding/decoding images using a motion vector Download PDFInfo
- Publication number
- US12003753B2 US12003753B2 US16/830,236 US202016830236A US12003753B2 US 12003753 B2 US12003753 B2 US 12003753B2 US 202016830236 A US202016830236 A US 202016830236A US 12003753 B2 US12003753 B2 US 12003753B2
- Authority
- US
- United States
- Prior art keywords
- motion vector
- reference picture
- block
- current
- motion
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 239000013598 vector Substances 0.000 title claims abstract description 398
- 238000000034 method Methods 0.000 title abstract description 105
- 208000037170 Delayed Emergence from Anesthesia Diseases 0.000 claims description 12
- 230000015654 memory Effects 0.000 abstract description 58
- 230000008569 process Effects 0.000 abstract description 48
- 230000002123 temporal effect Effects 0.000 description 57
- 238000007906 compression Methods 0.000 description 17
- 230000006835 compression Effects 0.000 description 13
- 238000001914 filtration Methods 0.000 description 10
- 238000005192 partition Methods 0.000 description 10
- 241000023320 Luma <angiosperm> Species 0.000 description 7
- OSWPMRLSEDHDFF-UHFFFAOYSA-N methyl salicylate Chemical compound COC(=O)C1=CC=CC=C1O OSWPMRLSEDHDFF-UHFFFAOYSA-N 0.000 description 7
- 230000006870 function Effects 0.000 description 6
- 238000005516 engineering process Methods 0.000 description 5
- 238000013139 quantization Methods 0.000 description 5
- 230000003044 adaptive effect Effects 0.000 description 4
- 238000010586 diagram Methods 0.000 description 4
- 230000004075 alteration Effects 0.000 description 1
- 230000008901 benefit Effects 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000000903 blocking effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 238000010276 construction Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
- H04N19/124—Quantisation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
- H04N19/136—Incoming video signal characteristics or properties
- H04N19/137—Motion inside a coding unit, e.g. average field, frame or block difference
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/42—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation
- H04N19/423—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements
- H04N19/426—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by implementation details or hardware specially adapted for video compression or decompression, e.g. dedicated software implementation characterised by memory arrangements using memory downsizing methods
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/60—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding
- H04N19/61—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding in combination with predictive coding
Definitions
- the present invention relates to image processing, and more particularly, to a video coding/decoding method using a clipped motion vector and an apparatus thereof.
- HD high definition
- UHD ultra high definition
- an inter prediction technology of predicting pixel values included in a current picture from a picture before and/or after the current picture an intra prediction technology of predicting pixel values using pixel information in the picture, an entropy coding technology of allocating a short code to a symbol having a high appearance frequency and a long code to a symbol having a low appearance frequency, or the like, may be used.
- FIG. 1 is a block diagram showing an example of a structure of an encoder according to an exemplary embodiment of the present invention.
- FIG. 2 is a block diagram showing an example of a structure of a decoder according to an exemplary embodiment of the present invention.
- FIG. 3 shows examples of a coding/decoding object picture and a reference picture.
- FIG. 4 shows an example of limiting a dynamic range of a motion vector.
- FIGS. 5 to 8 are flow charts showing a method of storing a motion vector of a reference picture.
- FIG. 9 shows an example of quantizing a motion vector.
- FIGS. 10 to 13 show examples of fetching motion information from a reference picture.
- FIG. 14 is a flow chart showing a method of encoding an image according to the exemplary embodiment of the present invention.
- FIG. 15 is a flow chart showing a method of decoding an image according to the exemplary embodiment of the present invention.
- the prevent invention provides a video coding/decoding method using a clipped motion vector and an apparatus thereof.
- the present invention also provides a method for clipping a motion vector of a reference picture.
- the present invention also provides a method for transmitting information on a motion vector.
- an image decoding apparatus includes a reference picture buffer for storing a reference picture; and a motion compensating unit for generating a prediction block using the reference picture and a motion vector of the reference picture.
- the motion vector of the reference picture is clipped in a predetermined range.
- the motion vector of the reference picture is magnitude scaled and is clipped in the range.
- the motion vector is clipped in a predetermined fixed value range.
- the motion vector of the reference picture is stored in a predetermined block unit.
- the motion compensating unit generates the prediction block using the motion vector of the reference picture stored in the predetermined block unit.
- the motion vector is a motion vector of a block decoded in an inter-prediction mode.
- an image decoding method includes clipping a motion vector of a reference picture in a predetermined range to generate a clipped motion vector; deriving a motion vector of a block to be decoded using the motion vector; and performing inter-prediction decoding using the motion vector of the block to be decoded.
- the method also includes magnitude scaling the motion vector of the reference picture.
- the motion vector of the magnitude scaled reference picture is clipped in the range.
- the motion vector is clipped in a predetermined fixed value range.
- the motion vector of the reference picture is stored in a predetermined block unit, and, m deriving the motion vector, the motion vector of the reference picture stored in the predetermined block unit is derived.
- the motion vector is a motion vector of a block decoded in an inter-prediction mode.
- an image encoding apparatus includes a reference picture buffer for storing a reference picture; and a motion compensating unit for generating a prediction blocking using the reference picture and a motion vector of the reference picture.
- the motion vector of the preference picture is clipped in a predetermined range.
- the motion vector of the reference picture is magnitude scaled and is clipped in the range.
- the motion vector is clipped in a predetermined fixed value range.
- the motion vector of the reference picture is stored in a predetermined block unit, and the motion compensating unit generates the prediction block using the motion vector of the reference picture stored in the predetermined block unit.
- the motion vector is a motion vector of a block encoded in an inter-prediction mode.
- the video may be coded using the clipped motion vector.
- a size of a memory required for storing motion vectors may be reduced.
- a memory access bandwidth required for fetching data from the memory may be reduced.
- first, ‘second’, etc. may be used to describe various components, but the components are not to be construed as being limited to the terms. That is, the terms are used to distinguish one component from another component.
- first may be named the ‘second’ component, and vice versa, without departing from the scope of the present invention.
- components described in exemplary embodiments of the present invention are independently shown only in order to indicate that they perform different characteristic functions. Therefore, the components that are independently shown do not mean that each of the components may not be implemented as one hardware or software. That is, each of the components is divided for convenience of explanation, a plurality of components may be combined with each other to thereby be operated as one component or one component may be divided into a plurality components to thereby be operated as the plurality of components, which are included in the scope of the present invention as long as it departs from essential characteristics of the present invention.
- components may not be indispensable components performing essential functions of the present invention, but be selective components improving only performance thereof.
- the present invention may also be implemented only by a structure including the indispensable components except for the selective components, and the structure including only the indispensable components is also included in the scope of the present invention.
- FIG. 1 is a block diagram showing an example of a structure of an encoder according to an exemplary embodiment of the present invention.
- the encoder 100 includes a motion predictor 111 , a motion compensator 112 , an intra predictor 120 , a switch 115 , a subtracter 125 , a transformer 130 , a quantizer 140 , an entropy encoder 150 , a dequantizer 160 , an inverse transformer 170 , an adder 175 , a filter unit 180 , and a reference picture buffer 190 .
- the encoder 100 encodes input images in an intra prediction mode or an inter prediction mode to encoder output a bitstream.
- the intra prediction means intra-picture prediction and the inter prediction means inter-picture prediction.
- the encoder 100 is switched between the intra prediction mode and the inter prediction mode through switching of the switch 115 .
- the encoder 100 generates a predicted block for an input block of the input image and then encodes a residual between the input block and the predicted block.
- the intra predictor 120 performs spatial prediction using pixel values of neighboring blocks which are coded already to generate predicted blocks.
- the motion predictor 111 searches a reference block optimally matched with the input block in a reference picture stored in the reference picture buffer 190 during a motion prediction process to obtain a motion vector.
- the motion compensator 112 performs motion-compensation using the motion vector to generate the predicted block.
- the motion vector may be a two dimensional vector used for inter prediction and represent an offset between a current coding treeblock and the reference block.
- the subtracter 125 generate a residual block based on the residual between the input block and the predicted block, and the transformer 130 transforms the residual block to output a transform coefficient.
- the quantizer 140 quantizes the transform coefficient to output the quantized coefficient.
- the entropy encoder 150 performs entropy encoding based on information obtained during an encoding/quantizing process to output the bitstream.
- the entropy encoding represents frequently generated symbols as a small number of bits, thereby reducing a size of a bitstream for a coding symbol. Therefore, the compression performance of a video may be expected to be improved through the entropy encoding.
- the entropy encoder 150 may use an encoding method such as exponential golomb, context-adaptive variable length coding (CAVLC), context-adaptive binary arithmetic coding (CABAC), or the like, for the entropy encoding.
- a coded picture needs to be again decoded and stored in order to be used as a reference picture for performing the inter prediction coding. Therefore, the dequantizer 160 dequantizes the quantized coefficient, and the inverse transformer 170 inversely transforms the dequantized coefficient to output a reconstructed residual block. The adder 175 adds the reconstructed residual block to the predicted block to generate a reconstructed block.
- the filter unit 180 is also called an adaptive in-loop filter and applies at least one of deblocking filtering, sample adaptive offset (SAO) compensation, adaptive loop filtering (ALF) to the reconstructed block.
- deblocking filtering means that block distortion occurred in a boundary between blocks is removed
- SAO compensation means that an appropriate offset is added to a pixel value in order to compensate for a coding error.
- ALF means that filtering is performed based on a comparison value between a reconstructed image and an original image.
- the reference picture buffer 190 stores the reconstructed block passing through the filter unit 180 therein.
- FIG. 2 is a block diagram showing an example of a structure of a decoder according to an exemplary embodiment of the present invention.
- a decoder includes an entropy decoder 210 , a dequantizer 220 , an inverse transformer 230 , an intra predictor 240 , a motion compensator 250 , an adder 255 , a filter unit 260 , and a reference picture buffer 270 .
- the decoder 200 decodes the bitstream in the intra prediction mode or the inter prediction mode to output a reconstructed image.
- the decoder 200 is switched between the intra prediction mode and the inter prediction mode through switching of the switch.
- the decoder 200 obtains a residual block from the bitstream to generate a predicted block and then adds the residual block and the predicted block to each other to generate a reconstructed block.
- the entropy decoder 210 performs entropy decoding based on probability distribution.
- the entropy decoding process is a process opposite to the above-mentioned entropy encoding process. That is, the entropy decoder 210 generates a symbol including a quantized coefficient from the bitstream in which a frequently generated symbol is represented as a small number of bits.
- the dequantizer 220 dequantizes the quantized coefficient, and the inverse transformer 230 inversely transforms the dequantized coefficient to generate a residual block.
- the intra predictor 240 performs spatial prediction using pixel values of neighboring blocks which are already coded to generate predicted blocks.
- the motion compensator 250 performs the motion-compensation using the motion vector and the reference picture stored in the reference picture buffer 270 to generate the predicted block.
- the adder 255 adds the predicted block to the residual block, and the filter unit 260 applies at least one of deblocking filtering, SAO compensation, ALF to the block passing through the adder to output a reconstructed image.
- the reconstructed image may be stored in the reference picture buffer 270 to thereby be used for the motion-compensation.
- a block means an encoding/decoding unit.
- an image is divided at a predetermined size and then encoded/decoded. Therefore, a block may also be called a coding unit (CU), a prediction unit (PU), a transform unit (TU), or the like, and a single block may also be divided into sub-blocks having a smaller size.
- CU coding unit
- PU prediction unit
- TU transform unit
- a prediction unit means a basic unit in which prediction and/or motion-compensation is performed.
- a prediction unit may be divided into a plurality of partitions, and each of the partitions may also be called a prediction unit partition.
- each of prediction unit partitions may become a basic unit in which prediction and/or motion-compensation are performed.
- a prediction unit may also mean prediction unit partitions.
- HEVC high efficiency video coding
- AMVP advanced motion vector prediction
- a motion vector (MV) of a block existing in a position that is the same as or corresponds to that of a coding treeblock, in a reference picture as well as motion vectors of reconstructed blocks positioned around the coding treeblock may be used.
- the block, existing in a position that is the same as or spatially corresponds to that of the coding treeblock, in the reference picture is called a collocated block
- a motion vector of the collocated block is called a collocated motion vector or a temporal motion vector.
- the collocated block may be a block, existing in a position similar to (that is, corresponding to) that of the coding treeblock, in the reference picture as well as a block existing in the same position as that of the coding treeblock.
- motion information is estimated from the collocated block as well as reconstructed blocks positioned around the coding treeblock to thereby be used as motion information of the coding treeblock.
- the motion information includes at least one of inter prediction mode information indicating a reference picture index, a motion vector, a uni-direction, a bi-direction, or the like, required at the time of inter prediction, a reference picture list, and prediction mode information on whether encoding is performed in an intra prediction mode or in an inter prediction mode.
- a predicted motion vector in the coding treeblock may be a motion vector of the collocated block, which is a block temporally adjacent to the coding treeblock, as well as motion vectors of neighboring blocks spatially adjacent to the coding treeblock.
- FIG. 3 shows examples of a coding/decoding object picture and a reference picture.
- a block X indicates a coding treeblock in an encoding/decoding object picture 310
- a block A, a block B, a block C, a block D, and a block E indicate reconstructed blocks positioned around the coding treeblock
- a block T in the reference picture 320 indicates a collocated block existing in a position corresponding to that of the coding treeblock.
- Which motion vector in the coding treeblock is used as the predicted motion vector may be recognized through a motion vector predictor index.
- motion vector predictor indices mvp_idx_10 and mvp_idx_11 for each reference picture list are transmitted to a decoder, and the decoder uses the same motion vector as a motion vector predicted by an encoder as a predicted motion vector.
- the motion vector may be stored only with a memory having a relative small size.
- a temporal motion vector since all motion vectors of the reference picture needs to be stored in a memory, a memory having a relatively large size is required, and a size of a memory access bandwidth required to fetch data from the memory also increases. Therefore, there is a need to more efficiently store the temporal motion vector in an application environment in which a memory space of a portable terminal, or the like, is not sufficient or power consumption is minimized.
- the motion vector is compressed in any ratio and then stored in the memory.
- a motion vector stored in a 4 ⁇ 4 block unit is stored in a 4 ⁇ 4 or more block unit to reduce the number of stored motion vectors.
- information on a compression ratio is transmitted.
- the information is transmitted through a sequence parameter set (SPS) as shown in Table 2.
- motion_vector_buffer_comp_ratio_log 2 indicates a compression ratio of the motion vector buffer compressing process.
- motion_vector_buffer_comp_ratio_log 2 is estimated to 0, and a motion vector buffer compressing ratio is represented by Equation 1.
- MVBufferCompRatio 1 ⁇ motion_vector_buffer_comp_ratio_log 2 [Equation 1]
- the method of reducing a spatial resolution of a motion vector as described above, it is possible to reduce the size of the required memory space and the memory access bandwidth using spatial correlation of the motion vector.
- the method of reducing a spatial resolution of a motion vector does not limit the dynamic range of the motion vector.
- a size of the memory space required in the above-mentioned example is reduced to about 0.8 Mbytes.
- the size of the required memory space may be further reduced to 0.37 Mbytes.
- the dynamic range of the motion vector is limited in order to reduce a size of a memory space required for storing the motion vector and a memory access bandwidth required for fetching data from the memory.
- the motion vector of the reference picture of which the dynamic range is limited may be used as a temporal motion vector in the coding treeblock.
- a dynamic range means a range between a minimum value and a maximum value of a negative component or a positive component of a motion vector based on 0, and a bit depth, which indicates a size of a space required for storing the motion vector, means a bit width.
- the motion vector means a motion vector of a reference picture, that is, a temporal motion vector.
- each component of the motion vector is out of the dynamic range, it is represented by the minimum value or the maximum value of the corresponding dynamic range.
- the X component of the motion vector is limited to 256.
- each component of the motion vector has a dynamic range of ⁇ 32 to +31, such that the motion vector is represented by ( ⁇ 32, 24), which is in its dynamic range.
- each component of the motion vector has a dynamic range of ⁇ 256 to +255, such that the motion vector is represented by ( ⁇ 49, 142) without a change.
- FIG. 4 shows an example of limiting a dynamic range of a motion vector.
- a bit depth may be reduced from 13 bits to 8 bits.
- Equation 2 Each component of a temporal motion vector is clipped as represented by Equations 2 and 3 in order to be stored in a bit depth of N bit(s).
- N indicates a positive integer.
- clippedMV_ X min(1 ⁇ ( N ⁇ 1) ⁇ 1,max( ⁇ 1 ⁇ ( N ⁇ 1),MV_ X )) [Equation 2]
- clippedMV_ Y min(1 ⁇ ( N ⁇ 1) ⁇ 1,max( ⁇ 1 ⁇ ( N ⁇ 1),MV_ Y )) [Equation 3]
- MV_X indicates an X component of the motion vector
- MV_Y indicates a Y component of the motion vector
- min(a,b) means an operation of outputting a smaller value in a and b
- max(a,b) means an operation of outputting a larger value in a and b.
- Each of clippedMV_X and clippedMV_Y indicates X and Y components of the clipped temporal motion vector and is stored in the memory to thereby be used as a temporal motion vector of the coding treeblock.
- the dynamic range of the motion vector is limited, such that a motion vector of a reference picture is stored.
- the decoded picture buffer means the reference picture buffer of FIG. 1 or FIG. 2 .
- a process of clipping each component of a motion vector is invoked in the case in which a slice_type is not equal to I.
- the process of clipping a motion vector is performed in a treeblock or largest coding unit (LCU) after a filtering process is finished.
- LCU largest coding unit
- Inputs in the process of clipping a motion vector are a location (xP, yP) specifying the top-left sample of the prediction unit relative to the top-left sample of the current picture, and motion vector matrices MvL0 and MvL1.
- Outputs in the process are the clipped motion vector matrices CMvL0 and CMvL1.
- Clip3(a, b, c) means a function of clipping c so as to exist in a range between a and b.
- FIGS. 5 to 8 are flow charts showing a method of storing a motion vector of a reference picture.
- the motion vector of the reference picture may be stored using both of an image buffer storing a reconstructed image and a motion vector buffer storing a motion vector.
- the reconstructed image is subjected to an in-loop filtering process (S 510 ) and the motion vector is subjected to a limiting dynamic range process (S 520 ) and then stored (S 540 ).
- both of an image buffer and a motion vector buffer are used, and the motion vector is subjected to a limiting dynamic range process (S 620 ) and a reducing spatial resolution process (S 630 ) and then stored (S 640 ).
- the reconstructed image is subjected to an in-loop filtering process (S 710 ) and then stored in an image buffer (S 740 ), and the motion vector is subjected to a limiting dynamic range process (S 720 ) and then stored in a motion vector buffer (S 750 ).
- the reconstructed image is subjected to an in-loop filtering process (S 810 ) and then stored in an image buffer (S 840 ), and the motion vector is subjected to a limiting dynamic range process (S 820 ) and a reducing spatial resolution process (S 830 ) and then stored (S 850 ).
- a sequence of the limiting dynamic range process S 620 or S 820 and the reducing spatial resolution process S 630 and S 830 is not limited, but may be changed.
- dynamic ranges of each component of the motion vector may be differently limited. For example, only one of a dynamic range of an X component and a dynamic range of a Y component may be limited or the dynamic range of the Y component may be further limited as compared to the dynamic range of the X component.
- the limited dynamic range of the motion vector is transmitted through a sequence parameter set, a picture parameter set (PPS), a slice header, or the like, and the decoder similarly performs limitation of a dynamic range of a temporal motion vector in the sequence, the picture, or the slice.
- a bit depth which is a size of a memory space required for storing the motion vector represented in the dynamic range may also be transmitted.
- the motion vector may be quantized and stored.
- precision of the motion vector is reduced.
- a quantizing method there are uniform quantization in which step sizes are uniform, non-uniform quantization in which step sizes are non-uniform, and the like.
- the step size in the quantization is set to a fixed value predefined between the encoder and the decoder or is transmitted from the encoder to the decoder through the sequence parameter set, the picture parameter set, the slice header, or the like.
- the decoder uses the quantized motion vector as it is or dequantizes and use the quantized motion vector.
- FIG. 9 shows an example of quantizing a motion vector. Referring to FIG. 9 , in the case in which the motion vector has a component value of 32 to 48, the motion vector is quantized to 40.
- the motion vector may be limited in a representation resolution and the stored.
- the representation resolution means an integer pixel unit (1 pixel unit), a fraction pixel unit (a 1 ⁇ 2 pixel unit, a 1 ⁇ 4 pixel unit, or the like).
- a resolution of the motion vector processed in a 1 ⁇ 4 pixel unit may be stored as an integer pixel.
- the representation resolution of the motion vector is set to a fixed value predefined between the encoder and the decoder or is transmitted from the encoder to the decoder through the sequence parameter set, the picture parameter set, the slice header, or the like.
- a limiting dynamic range process In addition, only with respect to some motion vectors among temporal motion vectors stored in a memory, a limiting dynamic range process, a reducing space resolution process, and a quantizing process of the motion vector may be performed.
- information on the dynamic range of the motion vector may be added and stored in the memory.
- a flag of 1 may be additionally stored
- a flag of 0 may be additionally stored.
- flag information may be stored together with the motion vector or be stored in a memory different from the memory in which the motion vector is stored.
- the flag information and the motion vector are stored in different memories, when in which dynamic range a specific motion vector is stored is recognized, arbitrary access to the flag information may be allowed.
- information on in which dynamic range some motion vectors are stored is transmitted through the sequence parameter set, the picture parameter set, the slice header, or the like, thereby making it possible to allow a decoder to perform an operation similar to that of an encoder.
- information on a block size of the motion vector may be added and stored in the memory.
- a flag of 1 may be additionally stored
- a flag of 0 may be additionally stored.
- flag information may be stored together with the motion vector or be stored in a memory different from the memory in which the motion vector is stored.
- the flag information and the motion vector are stored in different memories, when in which block size a specific motion vector is stored is recognized, arbitrary access to the flag information may be allowed.
- information on in which block size some motion vectors are stored is transmitted through the sequence parameter set, the picture parameter set, the slice header, or the like, thereby making it possible to allow a decoder to perform an operation similar to that of an encoder.
- information on precision of the motion vector may be added and stored in the memory.
- a flag of 1 may be additionally stored
- a flag of 0 may be additionally stored.
- flag information may be stored together with the motion vector or be stored in a memory different from the memory in which the motion vector is stored.
- the flag information and the motion vector are stored in different memories, when at which step size a specific motion vector is quantized and stored is recognized, arbitrary access to the flag information may be allowed.
- information on at which step size some motion vectors are quantized and stored is transmitted through the sequence parameter set, the picture parameter set, the slice header, or the like, thereby making it possible to allow a decoder to perform an operation similar to that of an encoder.
- the spatial resolution of the motion vector may be reduced and stored.
- the motion information includes at least one of inter prediction mode information indicating a reference picture index, a motion vector, a uni-direction, a bi-direction, or the like, required at the time of inter prediction, a reference picture list, and prediction mode information on whether an intra prediction mode is performed or an inter prediction mode is performed.
- motion information of a prediction unit having the largest partition size among a plurality of motion information of a specific region may be stored as representative motion information in the memory.
- the specific region may include a region in the coding treeblock and regions of neighboring blocks of the coding treeblock.
- the specific region may be a region including a block in which the motion information is stored in the case in which the entire picture or slice is divided at a predetermined size.
- the representative motion information may be stored in the memory.
- the most frequently generated motion information among the plurality of motion information included in the specific region may be stored as the representative motion information in the memory.
- the number of generation of the motion information for each size of the block, or the like may be calculated.
- motion information at a specific position among the plurality of motion information included in the specific region may be stored.
- the specific position which is a position included in the specific region, may be a fixed position of the specific region.
- the specific position may be selected as one of a plurality of positions. When the plurality of positions is used, a priority for each position may be determined, and the motion information may be stored in the memory according to the priority.
- the motion information included in the specific region is stored in the memory, since the motion information does not exist outside a boundary of a block coded in an intra prediction mode, a block coded in a pulse coded modulation (PCM) mode, a slice, or a picture, the motion information of the corresponding position may not be stored in the memory.
- PCM pulse coded modulation
- the specific position may be one sample position in a neighboring block or a position of the block.
- a medium value or average value among motion information of neighboring blocks which are coded in inter prediction may be stored in the memory.
- an average value of motion information of neighboring blocks may be stored in the memory.
- a size of the motion vector may be adjusted according to the reference picture index, the reference picture list, the inter prediction mode information, a picture order count, and the like.
- the stored motion information may be fetched.
- motion information of a position corresponding to that of the coding treeblock in the reference picture may be fetched.
- the position corresponding to that of the coding treeblock in the reference picture may be a fixed position in a specific region or a relative position from the position of the coding treeblock.
- FIGS. 10 to 13 show examples of fetching motion information from a reference picture.
- a block X indicates a coding treeblock in an encoding/decoding object picture 1010 , 1110 , 1210 , or 1310 , and a block A, a block B, a block C, a block D, and a block E indicate reconstructed neighboring blocks.
- a block T in the reference picture 1020 , 1120 , 1220 , and 1320 indicates a collocated block corresponding to the coding treeblock.
- a block Y in the reference picture 1320 of FIG. 13 indicates a block corresponding to a position other than the encoding/decoding object block.
- motion information corresponding to a position corresponding to a top-left pixel position among positions of a coding treeblock X in a reference picture may be fetched.
- motion information corresponding to a position corresponding to a central pixel position among positions of a coding treeblock X in a reference picture may be fetched.
- motion information corresponding to a position corresponding to a right-bottom pixel position among positions of a coding treeblock X in a reference picture may be fetched.
- motion information corresponding to a position corresponding to a pixel position other than a coding treeblock X in a reference picture may be fetched.
- An encoding/decoding method such as motion vector prediction, advanced motion vector prediction, motion information merge, motion information merge skip, or the like, may be performed using the motion information stored in the memory, that is, the motion information of the reference picture.
- the motion vector may be stored in the memory using at least one of a method of limiting a dynamic range of a motion vector, a method of reducing a spatial resolution of a motion vector, a method of quantizing a motion vector, and a method of reducing a representation resolution of a motion vector, and the stored motion vector may be used for predicting a motion vector of the coding treeblock and merging motion information thereof.
- a process of fetching the motion vector of the reference picture from the memory is called a process of deriving a temporal motion vector.
- TMVbitWidth indicates a bit width of a temporal motion vector stored in the memory.
- Inputs in the process of deriving a temporal motion vector are a location (xP, yP) specifying the top-left luma sample of the current prediction unit relative to the top-left sample of the current picture, variables specifying the width and the height of the prediction unit for luma, nPSW and nPSH, the reference index of the current prediction unit partition refIdxLX (with X being 0 or 1).
- Outputs in the process are the motion vector prediction mvLXCol and the availability flag availableFlagLXCol.
- the function RefPicOrderCnt(pic, refidx, LX) is specified by the value of PicOrderCnt of the picture that is the reference picture RefPicListX[refidx] of pic with X being 0 or 1. PicOrderCnt of the reference picture shall be maintained until the picture is marked as “non-exisiting.”
- Clip3(a, b, c) means a function of clipping c so as to exist in a range between a and b.
- variable colPic specifies the picture that contains the co-located partition as specified by RefPicList1 [0]. Otherwise (slice_type is equal to B and collocated_from_10_flag is equal to 1 or slice_type is equal to P), the variable colPic specifies the picture that contains the co-located partition as specified by RefPicList0[0].
- Variable colPu and its position are derived in the following ordered steps:
- Equation 8 Right-bottom luma position (xPRb, yPRb) of the current prediction unit is defined as represented by Equations 8 and 9.
- x PRb xP+nPSW [Equation 8]
- yPRb yP+nPSH [Equation 9]
- variable colPu is set as the prediction unit covering the modified position given by ((xPCtr>>4) ⁇ 4, (yPCtr>>4) ⁇ 4) inside the colPic.
- (xPCol, yPCol) is set equal to the top-left luma sample of the colPu relative to the top-left luma sample of the colPic.
- colPu If colPu is coded in an intra prediction mode or colPu is unavailable, both components of mvLXCol are set equal to 0 and availableFlagLXCol is set equal to 0.
- the motion vector mvCol, the reference index refldxCol and ListCol are set equal to MvL1[xPCol][yPCol], RefIdxColL1 and L1, respectively.
- Mv0Cross is equal to 0 and Mv1Cross is equal to 1.
- Mv0Cross is equal to Mv1Cross and reference index list is equal to L1
- the motion vector mvCol, the reference index refIdxCol and ListCol are set equal to MvL0[xPCol][yPCol], RefIdxColL0 and L0, respectively.
- variable availableFlagLXCol is set equal to 1 and operations of Equation 12 or Equations 13 to 18 are applied.
- tx (16384 +Abs ( td/ 2))/ td
- DistScaleFactor Clip3( ⁇ 1024,1023,( tb*tx+ 32)>>6)
- mv LX Col Clip3( ⁇ 1 ⁇ (TMVBitWidth ⁇ 1),1 ⁇ (TMVBitWidth ⁇ 1) ⁇ 1,mvCol)
- mvLXCol ClipMv((DistScaleFactor*mv LX Col′+128)>>8)
- Equation 16 where td and tb are derived as Equations 17 and 18.
- td Clip3( ⁇ 128,127,PicOrderCnt(colPic) ⁇ RefPicOrderCnt(colPic,refIdxCol,ListCol)) [Equation 17]
- tb Clip3( ⁇ 128,127,PicOrderCnt(currPic) ⁇ RefPicOrderCnt(currPic,refIdx LX,LX )) [Equation 18]
- mvLXCol is derived as scaled version of the motion vector mvCol.
- Equation 15 and 16 may be replaced with Equations 19 and 20.
- TMVBitWidth in the process of deriving a temporal motion vector may be transmitted from the encoder to the decoder through a sequence parameter set, a picture parameter set, a slice header, or the like.
- bit_width_temporal_motion_vector_minus8 of Table 5 specifies the bit width of the temporal motion vector component. When bit_width_temporal_motion_vector_minus8 is not present, it shall be inferred to be equal to 0.
- Information transmitting method 1 in the case in which motion vector is compressed and bit depth of motion vector is limited
- motion_vector_buffer_comp_ratio_log 2 specifies the compression ratio in the motion vector buffer compression process. When motion_vector_buffer_comp_ratio_log 2 is not present, it shall be inferred to be equal to 0.
- bit_depth_temporal_motion_vector_constraint_flag 1 specifies the temporal motion vector bit depth limiting constraint process is applied.
- bit_depth_temporal_motion_vector_minus8 specifies the bit depth of the temporal motion vector. When bit_depth_temporal_motion_vector_minus8 is not present, it shall be inferred to be equal to 0.
- bit_depth_temporal_motion_vector_constraint_flag 1 specifies the temporal motion vector bit depth constraint process is applied.
- bit_depth_temporal_motion_vector_minus8 specifies the bit depth of the temporal motion vector. When bit_depth_temporal_motion_vector_minus8 is not present, it shall be inferred to be equal to 0.
- bit_depth_temporal_motion_vector_minus8 specifies the bit depth of the temporal motion vector. When bit_depth_temporal_motion_vector_minus8 is not present, it shall be inferred to be equal to 0.
- Information transmitting method 4 in the case in which bit depth is limited with respect to each of X and Y components of motion vector
- bit_depth_temporal_motion_vector_constraint_flag 1 specifies the temporal motion vector bit depth constraint process is applied.
- bit_depth_temporal_motion_vector_x_minus8 specifies the bit depth of the temporal motion vector component x. When bit_depth_temporal_motion_vector_x_minus8 is not present, it shall be inferred to be equal to 0.
- bit_depth_temporal_motion_vector_y_minus8 specifies the bit depth of the temporal motion vector component y. When bit_depth_temporal_motion_vector_y_minus8 is not present, it shall be inferred to be equal to 0.
- motion_vector_buffer_comp_flag 1 specifies the motion vector buffer compression process is applied.
- motion_vector_buffer_comp_ratio_log 2 specifies the compression ratio in the motion vector buffer compression process. When motion_vector_buffer_comp_ratio_log 2 is not present, it shall be inferred to be equal to 0.
- the dynamic range of the temporal motion vector may be defined through a level of a video codec rather than being transmitted through the sequence parameter set, the picture parameter set, or the slice header.
- the encoder and the decoder may determine a limited dynamic range of the motion vector using level information.
- dynamic ranges and/or bit depths of each of the X and Y components of the motion vector may be differently defined, and minimum values and maximum values of each of the components may be defined.
- Tables 11 and 12 show an example of a case in which TMVBitWidth in the process of deriving a temporal motion vector described above is defined in the levels.
- MaxTMVBitWidth (Max Temporal Level MV component number bit width) 1 8 1b 8 1.1 8 1.2 8 1.3 8 2 8 2.1 8 2.2 8 3 8 3.1 10 4 10 4.1 10 4.2 10 5 10 5.1 10
- TMVBitWidth is set as MaxTMVBitWidth defined in the levels.
- MaxTMVBitWidth indicates a maximum bit width of a temporal motion vector when the temporal motion vector is stored in the memory.
- TMVBitWidth may also be defined in the levels, and a difference from the defined value (a delta value) may be transmitted through the sequence parameter set, the picture parameter set, or the slice header. That is, TMVBitWidth may be set to as a value obtained by adding the difference transmitted through the sequence parameter set, the picture parameter set, or the slice header to MaxTMVBitWidth defined in the levels.
- TMVBitWidth indicates a bit width of the temporal motion vector when the temporal motion vector is stored in the memory.
- MaxTMVBitWidth (Max Temporal Level MV component number bit depth) 1 8 1b 8 1.1 8 1.2 8 1.3 8 2 8 2.1 8 2.2 8 3 8 3.1 10 4 10 4.1 10 4.2 10 5 10 5.1 10
- delta_bit_width_temporal_motion_vector_minus8 specifies the delta bit width of the temporal motion vector component. When delta_bit_width_temporal_motion_vector_minus8 is not present, it shall be inferred to be equal to 0.
- dynamic ranges of each component of the temporal motion vector may also be defined in levels.
- MaxBR Max video bit MaxCPB rate
- Max CPB size MaxTmvR MaxMBPS MaxDpbMbs (1000 bits/s, (1000 bits, (Max MaxMvsPer2 Mb (Max MaxFS (Max 1200 bits/s, 1200 bits, Temporal MV (Max number macroblock (Max decoded cpbBrVdFactor pbBrVdFactor component MinCR of motion processing picture picture bits/s, or bits, or range (Min vectors per two Level rate) size) buffer size) cpbBrNalFactor cpbBrNalFactor (luma picture compression consecutive number (MB/s) (MBs) (MBs) bits/s) bits) samples) ratio) MBs) 1 1 485 99 396 64 175 [ ⁇ 64, +63.75] 2 — 1b 1 485 99 396 128 350 [ ⁇ 64, +63.75] 2 — 1.1 3 000 396 900 192 500 [ ⁇ 128, +127
- bit widths of each component of the temporal motion vector may also be defined in levels.
- MaxBR Max video bit MaxCPB rate
- Max CPB size MaxMBPS MaxDpbMbs (1000 bits/s, (1000 bits, MaxMvsPer2 Mb (Max MaxFS (Max 1200 bits/s, 1200 bits, (Max number macroblock (Max decoded cpbBrVdFactor cpbBrVdFactor MaxTMVBitWidth MinCR of motion processing picture picture bits/s, or bits, or (Max Temporal (Min vectors per two Level rate) size) buffer size) cpbBrNalFactor cpbBrNalFactor MV component compression consecutive number (MB/s) (MBs) (MBs) bits/s) bits) bit width) ratio) MBs) 1 1 485 99 396 64 175 8 2 — 1b 1 485 99 396 128 350 8 2 — 1.1 3 000 396 900 192 500 8 2 — 1.2 6 000 396 2 376 384 1 000 8 2 —
- MaxBR Max video bit MaxCPB rate
- Max CPB size MaxMBPS MaxDpbMbs (1000 bits/s, (1000 bits, MaxMvsPer2 Mb (Max MaxFS (Max 1200 bits/s, 1200 bits, (Max number macroblock (Max decoded cpbBrVdFactor cpbBrVdFactor MaxTMVBitWidth MinCR of motion processing picture picture bits/s, or bits, or (Max Temporal (Min vectors per two Level rate) size) buffer size) cpbBrNalFactor cpbBrNalFactor MV component compression consecutive number (MB/s) (MBs) (MBs) bits/s) bits) bit width) ratio) MBs) 1 1 485 99 396 64 175 8 2 — 1b 1 485 99 396 128 350 8 2 — 1.1 3 000 396 900 192 500 8 2 — 1.2 6 000 396 2 376 384 1 000 8 2 —
- MaxTMVBitWidth (Max Temporal Level MV component number bit width) 1 8 1b 8 1.1 8 1.2 8 1.3 8 2 8 2.1 8 2.2 8 3 8 3.1 10 4 10 4.1 10 4.2 10 5 10 5.1 10
- a bit width of a Y component of the temporal motion vector may also be defined in levels.
- MaxBR Max video bit MaxCPB rate
- Max CPB size MaxMBPS MaxDpbMbs (1000 bits/s, (1000 bits, MaxMvsPer2 Mb (Max MaxFS (Max 1200 bits/s, 1200 bits, (Max number macroblock (Max decoded cpbBrVdFactor cpbBrVdFactor MaxTMVYBitWidth MinCR of motion processing picture picture bits/s, or bits, or (Max Temporal (Min vectors per two Level rate) size) buffer size) cpbBrNalFactor cpbBrNalFactor MV component compression consecutive number (MB/s) (MBs) (MBs) bits/s) bits) bit width) ratio) MBs) 1 1 485 99 396 64 175 8 2 — 1b 1 485 99 396 128 350 8 2 — 1.1 3 000 396 900 192 500 8 2 — 1.2 6 000 396 2 376 384 1 000 8 2
- the dynamic range of the temporal motion vector may be defined as a fixed value predefined between the encoder and the decoder without transmission of information on a limitation of the motion vector or be stored in a form of a fixed bit depth.
- TMVBitWidth In the case in which TMVBitWidth is fixed to the same value and used in the encoder and the decoder, TMVBitWidth may be a positive integer such as 4, 6, 8, 10, 12, 14, 16, or the like.
- TMVBitWidth indicates the bit width of the temporal motion vector when the temporal motion vector is stored in the memory.
- FIG. 14 is a flow chart showing a method of encoding an image according to the exemplary embodiment of the present invention.
- the method of encoding an image includes a clipping step (S 1410 ), a storing step (S 1420 ), and an encoding step (S 1430 ).
- An apparatus of encoding an image and/or an apparatus of decoding an image clip a motion vector of a reference picture in a predetermined dynamic range (S 1410 ).
- the apparatus of encoding an image and/or the apparatus of decoding an image store the clipped motion vector of the reference picture in a buffer as described above through “II. Process of storing motion vector” (S 1420 ).
- the motion vector may be stored in the buffer together with or separately from the reconstructed image.
- the apparatus of encoding an image encodes a motion vector of a coding treeblock using the stored motion vector of the reference picture (S 1430 ).
- a motion vector of a block existing in a position that is the same or corresponds to that of the coding treeblock in the reference picture as well as motion vectors of reconstructed blocks positioned around the coding treeblock may be used. Therefore, the motion vector of the coding treeblock may also be a motion vector of the reference picture, that is, a temporal motion vector, as well as motion vectors of neighboring blocks adjacent to the coding treeblock.
- each component of the motion vector of the reference picture may be clipped in each dynamic range.
- a method of compressing a motion vector of a reference picture as well as a method of limiting a dynamic range of a motion vector of a reference picture may be used.
- a flag indicating the dynamic range and the motion vector and a parameter related thereto may be defined in a level of a video codec, a sequence parameter set, or the like.
- an encoding method such as motion vector prediction, advanced motion vector prediction, motion information merge, motion information merge skip, or the like, may be performed using the motion information stored in the memory, that is, the motion information of the reference picture.
- FIG. 15 is a flow chart showing a method of decoding an image according to the exemplary embodiment of the present invention.
- the method of decoding an image includes a clipping step (S 1510 ), a storing step (S 1520 ), a deriving step (S 1530 ), and a decoding step (S 1540 ).
- the clipping step (S 1510 ) and the storing step (S 1520 ) of FIG. 15 are similar to the clipping step (S 1410 ) and the storing step (S 1420 ) of FIG. 14 using “I. Process of clipping motion vector” and “II. Process of storing motion vector” described above.
- the deriving step (S 1530 ) of FIG. 15 uses “III. Process of deriving motion vector” described above and is symmetrical to the encoding step (S 1430 ) of FIG. 14 . Therefore, a detailed description thereof will be omitted.
- An apparatus of decoding an image performs inter prediction decoding using a motion vector of a coding treeblock (S 1540 ).
- the apparatus of decoding an image may store a motion vector in a memory using at least one of a method of limiting a dynamic range of a motion vector, a method of reducing a spatial resolution of a motion vector, a method of quantizing a motion vector, and a method of reducing a representation resolution of a motion vector, and use the stored motion vector for predicting a motion vector of the coding treeblock and merging motion information thereof.
- the apparatus of decoding an image may perform a decoding method such as motion vector prediction, advanced motion vector prediction, motion information merge, motion information merge skip, or the like, using the motion information stored in the memory, that is, the motion information of the reference picture.
- a decoding method such as motion vector prediction, advanced motion vector prediction, motion information merge, motion information merge skip, or the like, using the motion information stored in the memory, that is, the motion information of the reference picture.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
TABLE 1 | |
Descriptor | |
prediction_unit( x0, y0, log2PUWidth, log2PUHeight ) { | |
if( skip_flag [ x0 ][ y0 ] ) { | |
if( NumMVPCand( L0 ) > 1 ) | |
mpv_idx_l0[ x0 ][ y0 ] | ue(v) | ae(v) |
if( NumMVPCand( L1 ) > 1 ) | |
mpv_idx_l1[ x0 ][ y0 ] | ue(v) | ae(v) |
} else if( PredMode == MODE_INTRA ) { | |
... | |
} else {/* MODE MERGE, MODE_INTER */ | |
if( merge_flag[ x0 ][ y0 ] && NumMergeCandidates > 1 ) { | |
... | |
} else { | |
if( inter_pred_idc[ x0 ][ y0 ] != Pred_L1 ) { | |
if( NumMVPCand( L0 ) > 1 ) | |
mvp_idx_l0 | ue(v) | ae(v) |
} | |
if( inter_pred_idc[ x0 ][ y0 ] != Pred_L0 ) { | |
if( NumMVPCand( L1 ) > 1 ) | |
mvp_idx_l1 | ue(v) | ae(v) |
} | |
} | |
} | |
} | |
TABLE 2 | ||||
C | Descriptor | |||
seq_parameter_set_rbsp( ) { | ||||
..... | ||||
motion_vector_buffer_comp_flag | 0 | u(1) | ||
if ( motion_vector_buffer_comp_flag ) | ||||
motion_vector_buffer_comp_ratio_log2 | 0 | u(8) | ||
rbsp_trailing_bits( ) | 0 | |||
} | ||||
MVBufferCompRatio=1<<motion_vector_buffer_comp_ratio_log 2 [Equation 1]
clippedMV_X=min(1<<(N−1)−1,max(−1<<(N−1),MV_X)) [Equation 2]
clippedMV_Y=min(1<<(N−1)−1,max(−1<<(N−1),MV_Y)) [Equation 3]
TABLE 3 | |||||||
MV1-X | MV1-Y | MV2-X | MV2-Y | MV3-X | MV3-Y | MV4-X | MV4-Y |
MV5-X | MV5-Y | MV6-X | MV6-Y | MV7-X | MV7-Y | MV8-X | MV8-Y |
MV9-X | MV9-Y | MV10-X | MV10-Y | MV11-X | MV11-Y | MV12-X | MV12-Y |
TABLE 4 | |||||||
MV1-X | MV1-Y | MV2-X | MV2-Y | MV3-X | MV3-Y | MV4-X | MV4-Y |
MV5-X | MV5-Y | MV6-X | MV6-Y | MV7-X | MV7-Y | MV8-X | MV8-Y |
MV9-X | MV9-Y | MV10-X | MV10-Y | MV11-X | MV11-Y | MV12-X | MV12-Y |
MV13-X | MV13-Y | MV14-X | MV14-Y | MV15-X | MV15-Y | MV16-X | MV16-Y |
MV17-X | MV17-Y | MV18-X | MV18-Y | MV19-X | MV19-Y | MV20-X | MV20-Y |
MV21-X | MV21-Y | MV22-X | MV22-Y | MV23-X | MV23-Y | MV24-X | MV24-Y |
mvLX=MvLX[xP,yP] [Equation 4]
cmvLX[0]=Clip3(−1<<(TMVBitWidth−1),1<<(TMVBitWidth−1)−1,mvLX[0]) [Equation 5]
cmvLX[1]=Clip3(−1<<(TMVBitWidth−1),1<<(TMVBitWidth−1)−1,mvLX[1]) [Equation 6]
CMvLX[xP,yP]=cmvLX [Equation 7]
xPRb=xP+nPSW [Equation 8]
yPRb=yP+nPSH [Equation 9]
xPCtr=(xP+(nPSW>>1)−1 [Equation 10]
yPCtr=(yP+(nPSH>>1)−1 [Equation 11]
mvLXCol=Clip3(−1<<(TMVBitWidth−1),1<<(TMVBitWidth−1)−1,mvCol) [Equation 12]
tx=(16384+Abs(td/2))/td [Equation 13]
DistScaleFactor=Clip3(−1024,1023,(tb*tx+32)>>6) [Equation 14]
mvLXCol=Clip3(−1<<(TMVBitWidth−1),1<<(TMVBitWidth−1)−1,mvCol) [Equation 15]
mvLXCol=ClipMv((DistScaleFactor*mvLXCol′+128)>>8) [Equation 16]
where td and tb are derived as Equations 17 and 18.
td=Clip3(−128,127,PicOrderCnt(colPic)−RefPicOrderCnt(colPic,refIdxCol,ListCol)) [Equation 17]
tb=Clip3(−128,127,PicOrderCnt(currPic)−RefPicOrderCnt(currPic,refIdxLX,LX)) [Equation 18]
mvLXCol′=ClipMv((DistScaleFactor*mvLXCol+128)>>8) [Equation 19]
mvLXCol=Clip3(−1<<(TMVBitWidth−1),1<<(TMVBitWidth−1)−1,mvCol′) [Equation 20]
TABLE 5 | ||||
C | Descriptor | |||
seq_parameter_set_rbsp( ) { | ||||
..... | ||||
|
0 | se(v) | ||
..... | ||||
rbsp_trailing_bits( ) | 0 | |||
} | ||||
TMVBitWidth=bit_width_temporal_motion_vector_minus8+8 [Equation 21]
TABLE 6 | ||
C | Descriptor | |
seq_parameter_set_rbsp( ) { | ||
..... | ||
motion_vector_buffer_comp_flag | 0 | u(1) |
if( motion_vector_buffer_comp_flag ) | ||
motion_vector_buffer_comp_ratio_log2 | 0 | u(8) |
bit_depth_temporal_motion_vector_constraint_flag | 0 | u(1) |
if( bit_depth_temporal_motion_vector_constraint_flag ) | ||
bit_depth_temporal_motion_vector_minus8 | 0 | se(v) |
..... | ||
rbsp_trailing_bits( ) | 0 | |
} | ||
MTVBufferCompRatio=1<<motion_vector_buffer_comp_ratio_log 2 [Equation 22]
TMVBitDepth=bit_depth_temporal_motion_vector_minus8+8 [Equation 23]
TABLE 7 | ||
C | Descriptor | |
seq_parameter_set_rbsp( ) { | ||
..... | ||
bit_depth_temporal_motion_vector_constraint_flag | 0 | u(1) |
if( bit_depth_temporal_motion_vector_constraint_flag ) | ||
bit_depth_temporal_motion_vector_minus8 | 0 | se(v) |
..... | ||
rbsp_trailing_bits( ) | 0 | |
} | ||
TMVBitDepth=bit_depth_temporal_motion_vector_minus8+8 [Equation 24]
TABLE 8 | ||||
C | Descriptor | |||
seq_parameter_set_rbsp( ) { | ||||
..... | ||||
|
0 | se(v) | ||
..... | ||||
rbsp_trailing_bits( ) | 0 | |||
} | ||||
TMVBitDepth=bit_depth_temporal_motion_vector_minus8+8 [Equation 25]
TABLE 9 | ||
C | Descriptor | |
seq_parameter_set_rbsp( ) { | ||
..... | ||
bit_depth_temporal_motion_vector_constraint_flag | 0 | u(1) |
if( bit_depth_temporal_motion_vector_constraint_flag ) { | ||
|
0 | se(v) |
bit_depth_temporal_motion_vector_y_minus8 | 0 | se(v) |
} | ||
..... | ||
rbsp_trailing_bits( ) | 0 | |
} | ||
TMVXBitDepth=bit_depth_temporal_motion_vector_x_minus8+8 [Equation 26]
TMVXBitDepth=bit_depth_temporal_motion_vector_y_minus8+8 [Equation 27]
TABLE 10 | ||
C | Descriptor | |
seq_parameter_set_rbsp( ) { | ||
..... | ||
motion_vector_buffer_comp_flag | 0 | u(1) |
if( motion_vector_buffer_comp_flag ) { | ||
motion_vector_buffer_comp_ratio_log2 | 0 | u(8) |
bit_depth_temporal_motion_vector_minus8 | 0 | se(v) |
} | ||
..... | ||
rbsp_trailing_bits( ) | 0 | |
} | ||
MVBufferCompRatio=1<<motion_vector_buffer_comp_ratio_log 2 [Equation 28]
TABLE 11 | |||
MaxTMVBitWidth | |||
(Max Temporal | |||
Level | MV component | ||
number | bit width) | ||
1 | 8 | ||
|
8 | ||
1.1 | 8 | ||
1.2 | 8 | ||
1.3 | 8 | ||
2 | 8 | ||
2.1 | 8 | ||
2.2 | 8 | ||
3 | 8 | ||
3.1 | 10 | ||
4 | 10 | ||
4.1 | 10 | ||
4.2 | 10 | ||
5 | 10 | ||
5.1 | 10 | ||
TABLE 12 | |||
MaxTMVBitWidth | |||
(Max Temporal | |||
Level | MV component | ||
number | bit depth) | ||
1 | 8 | ||
|
8 | ||
1.1 | 8 | ||
1.2 | 8 | ||
1.3 | 8 | ||
2 | 8 | ||
2.1 | 8 | ||
2.2 | 8 | ||
3 | 8 | ||
3.1 | 10 | ||
4 | 10 | ||
4.1 | 10 | ||
4.2 | 10 | ||
5 | 10 | ||
5.1 | 10 | ||
TABLE 13 | ||
C | Descriptor | |
seq_parameter_set_rbsp( ) { | ||
..... | ||
|
0 | se(v) |
..... | ||
rbsp_trailing_bits( ) | 0 | |
} | ||
TMVBitWidth=delta_bit_width_temporal_motion_vector_minus8+MaxTMVBitWidth [Equation 29]
TABLE 14 | ||||||||
MaxBR | ||||||||
(Max video bit | MaxCPB | |||||||
rate) | (Max CPB size) | MaxTmvR | ||||||
MaxMBPS | MaxDpbMbs | (1000 bits/s, | (1000 bits, | (Max | MaxMvsPer2 Mb | |||
(Max | MaxFS | (Max | 1200 bits/s, | 1200 bits, | Temporal MV | (Max number | ||
macroblock | (Max | decoded | cpbBrVdFactor | pbBrVdFactor | component | MinCR | of motion | |
processing | picture | picture | bits/s, or | bits, or | range | (Min | vectors per two | |
Level | rate) | size) | buffer size) | cpbBrNalFactor | cpbBrNalFactor | (luma picture | compression | consecutive |
number | (MB/s) | (MBs) | (MBs) | bits/s) | bits) | samples) | ratio) | MBs) |
1 | 1 485 | 99 | 396 | 64 | 175 | [−64, +63.75] | 2 | — |
1b | 1 485 | 99 | 396 | 128 | 350 | [−64, +63.75] | 2 | — |
1.1 | 3 000 | 396 | 900 | 192 | 500 | [−128, +127.75] | 2 | — |
1.2 | 6 000 | 396 | 2 376 | 384 | 1 000 | [−128, +127.75] | 2 | — |
1.3 | 11 880 | 396 | 2 376 | 768 | 2 000 | [−128, +127.75] | 2 | — |
2 | 11 880 | 396 | 2 376 | 2 000 | 2 000 | [−128, +127.75] | 2 | — |
2.1 | 19 800 | 792 | 4 752 | 4 000 | 4 000 | [−256, +255.75] | 2 | — |
2.2 | 20 250 | 1 620 | 8 100 | 4 000 | 4 000 | [−256, +255.75] | 2 | — |
3 | 40 500 | 1 620 | 8 100 | 10 000 | 10 000 | [−256, +255.75] | 2 | 32 |
3.1 | 108 000 | 3 600 | 18 000 | 14 000 | 14 000 | [−512, +511.75] | 4 | 16 |
3.2 | 216 000 | 5 120 | 20 480 | 20 000 | 20 000 | [−512, +511.75] | 4 | 16 |
4 | 245 760 | 8 192 | 32 768 | 20 000 | 25 000 | [−512, +511.75] | 4 | 16 |
4.1 | 245 760 | 8 192 | 32 768 | 50 000 | 62 500 | [−512, +511.75] | 2 | 16 |
4.2 | 522 240 | 8 704 | 34 816 | 50 000 | 62 500 | [−512, +511.75] | 2 | 16 |
5 | 589 824 | 22 080 | 110 400 | 135 000 | 135 000 | [−512, +511.75] | 2 | 16 |
5.1 | 983 040 | 36 864 | 184 320 | 240 000 | 240 000 | [−512, +511.75] | 2 | 16 |
TABLE 15 | ||||||||
MaxBR | ||||||||
(Max video bit | MaxCPB | |||||||
rate) | (Max CPB size) | |||||||
MaxMBPS | MaxDpbMbs | (1000 bits/s, | (1000 bits, | MaxMvsPer2 Mb | ||||
(Max | MaxFS | (Max | 1200 bits/s, | 1200 bits, | (Max number | |||
macroblock | (Max | decoded | cpbBrVdFactor | cpbBrVdFactor | MaxTMVBitWidth | MinCR | of motion | |
processing | picture | picture | bits/s, or | bits, or | (Max Temporal | (Min | vectors per two | |
Level | rate) | size) | buffer size) | cpbBrNalFactor | cpbBrNalFactor | MV component | compression | consecutive |
number | (MB/s) | (MBs) | (MBs) | bits/s) | bits) | bit width) | ratio) | MBs) |
1 | 1 485 | 99 | 396 | 64 | 175 | 8 | 2 | — |
1b | 1 485 | 99 | 396 | 128 | 350 | 8 | 2 | — |
1.1 | 3 000 | 396 | 900 | 192 | 500 | 8 | 2 | — |
1.2 | 6 000 | 396 | 2 376 | 384 | 1 000 | 8 | 2 | — |
1.3 | 11 880 | 396 | 2 376 | 768 | 2 000 | 8 | 2 | — |
2 | 11 880 | 396 | 2 376 | 2 000 | 2 000 | 8 | 2 | — |
2.1 | 19 800 | 792 | 4 752 | 4 000 | 4 000 | 8 | 2 | — |
2.2 | 20 250 | 1 620 | 8 100 | 4 000 | 4 000 | 8 | 2 | — |
3 | 40 500 | 1 620 | 8 100 | 10 000 | 10 000 | 8 | 2 | 32 |
3.1 | 108 000 | 3 600 | 18 000 | 14 000 | 14 000 | 10 | 4 | 16 |
3.2 | 216 000 | 5 120 | 20 480 | 20 000 | 20 000 | 10 | 4 | 16 |
4 | 245 760 | 8 192 | 32 768 | 20 000 | 25 000 | 10 | 4 | 16 |
4.1 | 245 760 | 8 192 | 32 768 | 50 000 | 62 500 | 10 | 2 | 16 |
4.2 | 522 240 | 8 704 | 34 816 | 50 000 | 62 500 | 10 | 2 | 16 |
5 | 589 824 | 22 080 | 110 400 | 135 000 | 135 000 | 10 | 2 | 16 |
5.1 | 983 040 | 36 864 | 184 320 | 240 000 | 240 000 | 10 | 2 | 16 |
TABLE 16 | ||||||||
MaxBR | ||||||||
(Max video bit | MaxCPB | |||||||
rate) | (Max CPB size) | |||||||
MaxMBPS | MaxDpbMbs | (1000 bits/s, | (1000 bits, | MaxMvsPer2 Mb | ||||
(Max | MaxFS | (Max | 1200 bits/s, | 1200 bits, | (Max number | |||
macroblock | (Max | decoded | cpbBrVdFactor | cpbBrVdFactor | MaxTMVBitWidth | MinCR | of motion | |
processing | picture | picture | bits/s, or | bits, or | (Max Temporal | (Min | vectors per two | |
Level | rate) | size) | buffer size) | cpbBrNalFactor | cpbBrNalFactor | MV component | compression | consecutive |
number | (MB/s) | (MBs) | (MBs) | bits/s) | bits) | bit width) | ratio) | MBs) |
1 | 1 485 | 99 | 396 | 64 | 175 | 8 | 2 | — |
1b | 1 485 | 99 | 396 | 128 | 350 | 8 | 2 | — |
1.1 | 3 000 | 396 | 900 | 192 | 500 | 8 | 2 | — |
1.2 | 6 000 | 396 | 2 376 | 384 | 1 000 | 8 | 2 | — |
1.3 | 11 880 | 396 | 2 376 | 768 | 2 000 | 8 | 2 | — |
2 | 11 880 | 396 | 2 376 | 2 000 | 2 000 | 8 | 2 | — |
2.1 | 19 800 | 792 | 4 752 | 4 000 | 4 000 | 8 | 2 | — |
2.2 | 20 250 | 1 620 | 8 100 | 4 000 | 4 000 | 8 | 2 | — |
3 | 40 500 | 1 620 | 8 100 | 10 000 | 10 000 | 8 | 2 | 32 |
3.1 | 108 000 | 3 600 | 18 000 | 14 000 | 14 000 | 10 | 4 | 16 |
3.2 | 216 000 | 5 120 | 20 480 | 20 000 | 20 000 | 10 | 4 | 16 |
4 | 245 760 | 8 192 | 32 768 | 20 000 | 25 000 | 10 | 4 | 16 |
4.1 | 245 760 | 8 192 | 32 768 | 50 000 | 62 500 | 10 | 2 | 16 |
4.2 | 522 240 | 8 704 | 34 816 | 50 000 | 62 500 | 10 | 2 | 16 |
5 | 589 824 | 22 080 | 110 400 | 135 000 | 135 000 | 10 | 2 | 16 |
5.1 | 983 040 | 36 864 | 184 320 | 240 000 | 240 000 | 10 | 2 | 16 |
TABLE 17 | |||
MaxTMVBitWidth | |||
(Max Temporal | |||
Level | MV component | ||
number | bit width) | ||
1 | 8 | ||
|
8 | ||
1.1 | 8 | ||
1.2 | 8 | ||
1.3 | 8 | ||
2 | 8 | ||
2.1 | 8 | ||
2.2 | 8 | ||
3 | 8 | ||
3.1 | 10 | ||
4 | 10 | ||
4.1 | 10 | ||
4.2 | 10 | ||
5 | 10 | ||
5.1 | 10 | ||
TABLE 18 | ||||||||
MaxBR | ||||||||
(Max video bit | MaxCPB | |||||||
rate) | (Max CPB size) | |||||||
MaxMBPS | MaxDpbMbs | (1000 bits/s, | (1000 bits, | MaxMvsPer2 Mb | ||||
(Max | MaxFS | (Max | 1200 bits/s, | 1200 bits, | (Max number | |||
macroblock | (Max | decoded | cpbBrVdFactor | cpbBrVdFactor | MaxTMVYBitWidth | MinCR | of motion | |
processing | picture | picture | bits/s, or | bits, or | (Max Temporal | (Min | vectors per two | |
Level | rate) | size) | buffer size) | cpbBrNalFactor | cpbBrNalFactor | MV component | compression | consecutive |
number | (MB/s) | (MBs) | (MBs) | bits/s) | bits) | bit width) | ratio) | MBs) |
1 | 1 485 | 99 | 396 | 64 | 175 | 8 | 2 | — |
1b | 1 485 | 99 | 396 | 128 | 350 | 8 | 2 | — |
1.1 | 3 000 | 396 | 900 | 192 | 500 | 8 | 2 | — |
1.2 | 6 000 | 396 | 2 376 | 384 | 1 000 | 8 | 2 | — |
1.3 | 11 880 | 396 | 2 376 | 768 | 2 000 | 8 | 2 | — |
2 | 11 880 | 396 | 2 376 | 2 000 | 2 000 | 8 | 2 | — |
2.1 | 19 800 | 792 | 4 752 | 4 000 | 4 000 | 8 | 2 | — |
2.2 | 20 250 | 1 620 | 8 100 | 4 000 | 4 000 | 8 | 2 | — |
3 | 40 500 | 1 620 | 8 100 | 10 000 | 10 000 | 8 | 2 | 32 |
3.1 | 108 000 | 3 600 | 18 000 | 14 000 | 14 000 | 10 | 4 | 16 |
3.2 | 216 000 | 5 120 | 20 480 | 20 000 | 20 000 | 10 | 4 | 16 |
4 | 245 760 | 8 192 | 32 768 | 20 000 | 25 000 | 10 | 4 | 16 |
4.1 | 245 760 | 8 192 | 32 768 | 50 000 | 62 500 | 10 | 2 | 16 |
4.2 | 522 240 | 8 704 | 34 816 | 50 000 | 62 500 | 10 | 2 | 16 |
5 | 589 824 | 22 080 | 110 400 | 135 000 | 135 000 | 10 | 2 | 16 |
5.1 | 983 040 | 36 864 | 184 320 | 240 000 | 240 000 | 10 | 2 | 16 |
Claims (7)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/830,236 US12003753B2 (en) | 2011-01-31 | 2020-03-25 | Method and apparatus for encoding/decoding images using a motion vector |
US17/538,797 US12028545B2 (en) | 2011-01-31 | 2021-11-30 | Method and apparatus for encoding/decoding images using a motion vector |
Applications Claiming Priority (14)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR10-2011-0009636 | 2011-01-31 | ||
KR20110009636 | 2011-01-31 | ||
KR20110019166 | 2011-03-03 | ||
KR10-2011-0019166 | 2011-03-03 | ||
KR1020110050853A KR20120088488A (en) | 2011-01-31 | 2011-05-27 | method for storing temporal motion vector and apparatus using the same |
KR10-2011-0050853 | 2011-05-27 | ||
KR1020110065707A KR20120088494A (en) | 2011-01-31 | 2011-07-01 | method for storing temporal motion vector and apparatus using the same |
KR10-2011-0065707 | 2011-07-01 | ||
PCT/KR2012/000770 WO2012105807A2 (en) | 2011-01-31 | 2012-01-31 | Method and apparatus for encoding/decoding images using a motion vector |
KR1020120010096A KR101428030B1 (en) | 2011-01-31 | 2012-01-31 | Video decoding apparatus using motion vector |
KR10-2012-0010096 | 2012-01-31 | ||
US201313979214A | 2013-07-11 | 2013-07-11 | |
US16/249,146 US10645411B2 (en) | 2011-01-31 | 2019-01-16 | Method and apparatus for encoding/decoding images using a motion vector |
US16/830,236 US12003753B2 (en) | 2011-01-31 | 2020-03-25 | Method and apparatus for encoding/decoding images using a motion vector |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/249,146 Continuation US10645411B2 (en) | 2011-01-31 | 2019-01-16 | Method and apparatus for encoding/decoding images using a motion vector |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US17/538,797 Continuation US12028545B2 (en) | 2011-01-31 | 2021-11-30 | Method and apparatus for encoding/decoding images using a motion vector |
Publications (2)
Publication Number | Publication Date |
---|---|
US20200228822A1 US20200228822A1 (en) | 2020-07-16 |
US12003753B2 true US12003753B2 (en) | 2024-06-04 |
Family
ID=46873758
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/979,214 Active 2033-02-04 US10244252B2 (en) | 2011-01-31 | 2012-01-31 | Method and apparatus for encoding/decoding images using a motion vector |
US16/249,146 Active US10645411B2 (en) | 2011-01-31 | 2019-01-16 | Method and apparatus for encoding/decoding images using a motion vector |
US16/830,236 Active US12003753B2 (en) | 2011-01-31 | 2020-03-25 | Method and apparatus for encoding/decoding images using a motion vector |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US13/979,214 Active 2033-02-04 US10244252B2 (en) | 2011-01-31 | 2012-01-31 | Method and apparatus for encoding/decoding images using a motion vector |
US16/249,146 Active US10645411B2 (en) | 2011-01-31 | 2019-01-16 | Method and apparatus for encoding/decoding images using a motion vector |
Country Status (16)
Country | Link |
---|---|
US (3) | US10244252B2 (en) |
EP (2) | EP3930332A1 (en) |
JP (6) | JP5911890B2 (en) |
KR (5) | KR20120088488A (en) |
CN (11) | CN107846596A (en) |
BR (5) | BR122020015452B1 (en) |
CA (3) | CA3220287A1 (en) |
DK (1) | DK2672708T3 (en) |
ES (1) | ES2899990T3 (en) |
HK (2) | HK1251838A1 (en) |
HU (1) | HUE056876T2 (en) |
PL (1) | PL2672708T3 (en) |
PT (1) | PT2672708T (en) |
RU (1) | RU2586017C2 (en) |
SI (1) | SI2672708T1 (en) |
WO (1) | WO2012105807A2 (en) |
Families Citing this family (35)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20120088488A (en) * | 2011-01-31 | 2012-08-08 | 한국전자통신연구원 | method for storing temporal motion vector and apparatus using the same |
EP2904773A4 (en) | 2012-10-03 | 2016-12-07 | Hfi Innovation Inc | Method and apparatus of motion data buffer reduction for three-dimensional video coding |
US10015515B2 (en) * | 2013-06-21 | 2018-07-03 | Qualcomm Incorporated | Intra prediction from a predictive block |
US10523952B2 (en) | 2014-01-08 | 2019-12-31 | Sony Corporation | Decoding apparatus and decoding method, and coding apparatus and coding method |
KR102105606B1 (en) | 2014-06-02 | 2020-05-04 | 한국전자통신연구원 | Apparatus for compressing data |
CA2961681C (en) | 2014-09-30 | 2022-08-09 | Hfi Innovation Inc. | Method of adaptive motion vetor resolution for video coding |
WO2017052250A1 (en) * | 2015-09-23 | 2017-03-30 | 엘지전자(주) | Image encoding/decoding method and device for same |
KR20170058838A (en) | 2015-11-19 | 2017-05-29 | 한국전자통신연구원 | Method and apparatus for encoding/decoding of improved inter prediction |
CN106954074B (en) * | 2016-01-07 | 2019-12-20 | 青岛海信电器股份有限公司 | Video data processing method and device |
TWI762260B (en) | 2016-02-09 | 2022-04-21 | 弗勞恩霍夫爾協會 | Concept for picture/video data streams allowing efficient reducibility or efficient random access |
CN105744275B (en) * | 2016-02-22 | 2019-04-05 | 青岛海信电器股份有限公司 | A kind of input of video data, output method and device |
US10827186B2 (en) * | 2016-08-25 | 2020-11-03 | Intel Corporation | Method and system of video coding with context decoding and reconstruction bypass |
GB2576846A (en) | 2017-04-21 | 2020-03-04 | Zenimax Media Inc | Systems and methods for game-generated motion vectors |
CN113628240A (en) | 2017-04-21 | 2021-11-09 | 泽尼马克斯媒体公司 | Player input motion compensation by anticipatory motion vectors |
EP3616406B1 (en) * | 2017-05-18 | 2024-03-20 | HFI Innovation Inc. | Method and apparatus of motion vector constraint for video coding |
CN111758259B (en) | 2018-02-28 | 2024-06-07 | 三星电子株式会社 | Video decoding method and apparatus, and video encoding method and apparatus |
WO2019194436A1 (en) | 2018-04-02 | 2019-10-10 | 엘지전자 주식회사 | Image coding method based on motion vector and apparatus therefor |
US10873748B2 (en) * | 2018-05-12 | 2020-12-22 | Qualcomm Incorporated | Storage of high precision motion vectors in video coding |
CN110557641B (en) | 2018-06-04 | 2024-01-16 | 华为技术有限公司 | Method and device for acquiring motion vector |
JP2021529462A (en) | 2018-06-29 | 2021-10-28 | ヴィド スケール インコーポレイテッド | Selection of adaptive control points for video coding based on affine motion model |
WO2020003259A1 (en) | 2018-06-29 | 2020-01-02 | Beijing Bytedance Network Technology Co., Ltd. | Improved tmvp derivation |
US20220150529A1 (en) * | 2018-09-17 | 2022-05-12 | Electronics And Telecommunications Research Institute | Image encoding/decoding method and apparatus, and recording medium storing bitstream |
CN112997494B (en) * | 2018-10-08 | 2023-05-09 | 北京达佳互联信息技术有限公司 | Motion vector storage for video coding |
US11375230B2 (en) | 2018-11-16 | 2022-06-28 | Sharp Kabushiki Kaisha | Systems and methods for deriving a motion vector prediction in video coding |
WO2020098810A1 (en) | 2018-11-17 | 2020-05-22 | Beijing Bytedance Network Technology Co., Ltd. | Merge with motion vector difference in video processing |
WO2020125754A1 (en) * | 2018-12-21 | 2020-06-25 | Beijing Bytedance Network Technology Co., Ltd. | Motion vector derivation using higher bit-depth precision |
JP7209092B2 (en) * | 2018-12-21 | 2023-01-19 | 北京字節跳動網絡技術有限公司 | Motion vector prediction in merge by motion vector difference (MMVD) mode |
CN112913236B (en) | 2018-12-29 | 2022-05-31 | 华为技术有限公司 | Encoder, decoder and corresponding methods using compressed MV storage |
WO2020251268A1 (en) * | 2019-06-11 | 2020-12-17 | 엘지전자 주식회사 | Image decoding method for chroma component and device therefor |
JP2022544164A (en) | 2019-08-06 | 2022-10-17 | オーピー ソリューションズ, エルエルシー | Implicit Signaling of Adaptive Resolution Management Based on Frame Type |
BR112022002204A2 (en) * | 2019-08-06 | 2022-10-18 | Op Solutions Llc | ADAPTIVE RESOLUTION MANAGEMENT FORECAST SIZING |
WO2021026324A1 (en) * | 2019-08-06 | 2021-02-11 | Op Solutions | Adaptive resolution management prediction rescaling |
AU2020326881A1 (en) | 2019-08-06 | 2022-03-24 | Op Solutions, Llc | Block-based adaptive resolution management |
BR112022008918A2 (en) | 2019-11-08 | 2022-08-02 | Op Solutions Llc | METHODS AND SYSTEMS FOR ADAPTABLE CUTTING |
KR20220093915A (en) | 2020-12-28 | 2022-07-05 | 삼성전자주식회사 | Method for detecting stochastic weakness of semiconductor integrated circuit and computer system performing the same |
Citations (46)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5262854A (en) | 1992-02-21 | 1993-11-16 | Rca Thomson Licensing Corporation | Lower resolution HDTV receivers |
JPH1188888A (en) | 1997-06-25 | 1999-03-30 | Nippon Telegr & Teleph Corp <Ntt> | Method for predictively encoding moving vector, method for decoding moving vector, predictively encoding device, decoding device, and recording medium recording predictively encoding program and decoding program for moving vector |
JPH11122624A (en) | 1997-10-16 | 1999-04-30 | Matsushita Electric Ind Co Ltd | Method and system for reducing video decoder processing amount |
EP0921688A1 (en) | 1997-06-25 | 1999-06-09 | Nippon Telegraph and Telephone Corporation | Moving vector predictive coding method and moving vector decoding method, predictive coding device and decoding device, and storage medium stored with moving vector predictive coding program and moving vector decoding program |
US20030133512A1 (en) | 2002-01-11 | 2003-07-17 | Shankar Moni | Spatially transcoding a video stream |
US20030174776A1 (en) * | 1997-06-25 | 2003-09-18 | Nippon Telegraph And Telephone Corporation | Motion vector predictive encoding method, motion vector decoding method, predictive encoding apparatus and decoding apparatus, and storage media storing motion vector predictive encoding and decoding programs |
WO2004008734A2 (en) | 2002-07-17 | 2004-01-22 | Dilithium Networks Pty Limited | Method and apparatus for transcoding between hybrid video codec bitstreams |
KR20040016856A (en) | 2001-12-25 | 2004-02-25 | 마츠시타 덴끼 산교 가부시키가이샤 | Moving picture compression/coding apparatus and motion vector detection method |
KR20040035777A (en) | 2001-09-12 | 2004-04-29 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Motion estimation and/or compensation |
US20040234143A1 (en) * | 2002-07-02 | 2004-11-25 | Makoto Hagai | Image encoding method and picture decoding method |
US20050013372A1 (en) | 2003-07-18 | 2005-01-20 | Microsoft Corporation | Extended range motion vectors |
US6982663B2 (en) | 2002-07-10 | 2006-01-03 | Lsi Logic Corporation | Method and system for symbol binarization |
US20060133486A1 (en) | 2002-10-01 | 2006-06-22 | Thomson Licensing S.A. | Implicit weighting of reference pictures in a video decoder |
US20070014359A1 (en) * | 2003-10-09 | 2007-01-18 | Cristina Gomila | Direct mode derivation process for error concealment |
US20070237232A1 (en) | 2006-04-07 | 2007-10-11 | Microsoft Corporation | Dynamic selection of motion estimation search ranges and extended motion vector ranges |
CN101090499A (en) | 2002-07-17 | 2007-12-19 | 达丽星网络有限公司 | Method and apparatus for transcoding between hybrid video codec bitstreams |
CN101115200A (en) | 2007-04-20 | 2008-01-30 | 西安交通大学 | Effective motion vector telescopic encoding method |
EP1924099A1 (en) | 2006-09-08 | 2008-05-21 | Kabushiki Kaisha Toshiba | Frame interpolating circuit, frame interpolating method, and display apparatus |
US20080165860A1 (en) | 2006-08-31 | 2008-07-10 | Zohair Sahraoui | H.264 Data processing |
KR20080070976A (en) | 2007-01-29 | 2008-08-01 | 삼성전자주식회사 | Method and apparatus for video encoding, and method and apparatus for video decoding |
RU2335859C2 (en) | 2003-12-22 | 2008-10-10 | Кэнон Кабусики Кайся | Full-motion video encoding device, method and control software for the device |
US20090034618A1 (en) | 2007-08-03 | 2009-02-05 | Fu Frank | Decoding method and apparatus for block-based digitally encoded picture |
CN101379829A (en) | 2006-02-02 | 2009-03-04 | 汤姆逊许可公司 | Method and apparatus for adaptive weight selection for motion compensated prediction |
CN101379511A (en) | 2005-03-18 | 2009-03-04 | 夏普株式会社 | Methods and systems for extended spatial scalability with picture-level adaptation |
WO2009064615A1 (en) | 2007-11-15 | 2009-05-22 | General Instrument Corporation | Method and apparatus for performing motion estimation |
CN101448154A (en) | 2007-11-27 | 2009-06-03 | 联发科技股份有限公司 | Motion compensation method and integrated circuit utilizing the same |
US20090304084A1 (en) * | 2008-03-19 | 2009-12-10 | Nokia Corporation | Combined motion vector and reference index prediction for video coding |
US20100135387A1 (en) | 2007-04-12 | 2010-06-03 | Thomson Licensing | Method and apparatus for context dependent merging for skip-direct modes for video encoding and decoding |
CN101841712A (en) | 2010-04-28 | 2010-09-22 | 广西大学 | B-frame expansion direct mode oriented to panoramic video coding |
CN101873483A (en) | 2009-04-24 | 2010-10-27 | 深圳市九洲电器有限公司 | Motion estimation method and coding chip and device using same |
US20100329329A1 (en) | 2009-06-24 | 2010-12-30 | Qualcomm Incorporated | 8-point transform for media data coding |
JP2011010197A (en) | 2009-06-29 | 2011-01-13 | Mitsubishi Electric Corp | Image encoder and image decoder |
KR20110017302A (en) | 2009-08-13 | 2011-02-21 | 삼성전자주식회사 | Method and apparatus for encoding/decoding image by using motion vector accuracy control |
US20120134415A1 (en) | 2010-11-29 | 2012-05-31 | Mediatek Inc. | Method and Apparatus of Extended Motion Vector Predictor |
US20120134416A1 (en) * | 2010-11-29 | 2012-05-31 | Mediatek Inc. | Method and Apparatus for Derivation of MV/MVP Candidate for Inter/Skip/Merge Modes |
US20120207220A1 (en) * | 2009-08-21 | 2012-08-16 | Sk Telecom Co., Ltd. | Method and apparatus for encoding/decoding images using adaptive motion vector resolution |
US20130003849A1 (en) | 2011-07-01 | 2013-01-03 | Qualcomm Incorporated | Video coding using adaptive motion vector resolution |
US20130070846A1 (en) | 2010-03-08 | 2013-03-21 | Sk Telecom Co., Ltd. | Motion vector encoding/decoding method and apparatus using a motion vector resolution combination, and image encoding/decoding method and apparatus using same |
US20130083853A1 (en) | 2011-10-04 | 2013-04-04 | Qualcomm Incorporated | Motion vector predictor candidate clipping removal for video coding |
US20130128976A1 (en) | 2011-11-18 | 2013-05-23 | FUJITSU LlMITED | Method of coding moving image and method of decoding moving image |
US8565308B2 (en) * | 2006-08-17 | 2013-10-22 | Fujitsu Semiconductor Limited | Interframe prediction processor with address management mechanism for motion vector storage |
US20130294522A1 (en) | 2011-01-31 | 2013-11-07 | Electronics And Telecommunications Research Institute | Method and apparatus for encoding/decoding images using a motion vector |
US8837605B2 (en) | 2006-09-26 | 2014-09-16 | Onmobile Global Limited | Method and apparatus for compressed video bitstream conversion with reduced-algorithmic-delay |
US9258573B2 (en) | 2010-12-07 | 2016-02-09 | Panasonic Intellectual Property Corporation Of America | Pixel adaptive intra smoothing |
US9307239B2 (en) * | 2011-03-14 | 2016-04-05 | Mediatek Inc. | Method and apparatus for derivation of motion vector candidate and motion vector prediction candidate |
US9609346B2 (en) * | 2011-03-14 | 2017-03-28 | Hfi Innovation Inc. | Method and apparatus for deriving temporal motion vector prediction |
Family Cites Families (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP5738549B2 (en) | 2009-07-22 | 2015-06-24 | 株式会社Sumco | Crane apparatus for packaged quartz glass crucible and packing method for packaged quartz glass crucible using this apparatus |
KR20110019166A (en) | 2009-08-19 | 2011-02-25 | 삼화주철공업 주식회사 | Manhole for preventing a noise |
KR101074238B1 (en) | 2009-11-09 | 2011-10-14 | 부경대학교 산학협력단 | Production Process of Monosaccharide and Amino Acid fom cuttlefish, chub mackerel by Sub- and Supercritical Water Hydrolysis |
-
2011
- 2011-05-27 KR KR1020110050853A patent/KR20120088488A/en unknown
-
2012
- 2012-01-31 CN CN201711419541.8A patent/CN107846596A/en active Pending
- 2012-01-31 CA CA3220287A patent/CA3220287A1/en active Pending
- 2012-01-31 CN CN201711418796.2A patent/CN108174221A/en active Pending
- 2012-01-31 DK DK12742304.4T patent/DK2672708T3/en active
- 2012-01-31 SI SI201231970T patent/SI2672708T1/en unknown
- 2012-01-31 CN CN201711418133.0A patent/CN108174219B/en active Active
- 2012-01-31 ES ES12742304T patent/ES2899990T3/en active Active
- 2012-01-31 CN CN201711418151.9A patent/CN108124161B/en active Active
- 2012-01-31 CN CN201280015709.8A patent/CN103583044B/en active Active
- 2012-01-31 EP EP21176802.3A patent/EP3930332A1/en active Pending
- 2012-01-31 CA CA2826157A patent/CA2826157C/en active Active
- 2012-01-31 CN CN201711418703.6A patent/CN108124162B/en active Active
- 2012-01-31 CA CA3050903A patent/CA3050903C/en active Active
- 2012-01-31 CN CN201711418724.8A patent/CN108174215B/en active Active
- 2012-01-31 CN CN201711418175.4A patent/CN108174220A/en active Pending
- 2012-01-31 CN CN201711419543.7A patent/CN107888916A/en active Pending
- 2012-01-31 CN CN201711419501.3A patent/CN107888927B/en active Active
- 2012-01-31 BR BR122020015452-7A patent/BR122020015452B1/en active IP Right Grant
- 2012-01-31 HU HUE12742304A patent/HUE056876T2/en unknown
- 2012-01-31 BR BR112013019495-2A patent/BR112013019495B1/en active IP Right Grant
- 2012-01-31 BR BR122014018140-0A patent/BR122014018140B1/en active IP Right Grant
- 2012-01-31 US US13/979,214 patent/US10244252B2/en active Active
- 2012-01-31 WO PCT/KR2012/000770 patent/WO2012105807A2/en active Application Filing
- 2012-01-31 JP JP2013551919A patent/JP5911890B2/en active Active
- 2012-01-31 BR BR122020015455-1A patent/BR122020015455B1/en active IP Right Grant
- 2012-01-31 RU RU2013140464/08A patent/RU2586017C2/en active
- 2012-01-31 EP EP12742304.4A patent/EP2672708B1/en active Active
- 2012-01-31 PL PL12742304T patent/PL2672708T3/en unknown
- 2012-01-31 PT PT127423044T patent/PT2672708T/en unknown
- 2012-01-31 BR BR122020015411-0A patent/BR122020015411B1/en active IP Right Grant
- 2012-01-31 CN CN201711418799.6A patent/CN108174216A/en active Pending
-
2013
- 2013-07-15 KR KR1020130082552A patent/KR101461498B1/en active IP Right Grant
- 2013-07-15 KR KR1020130082553A patent/KR101461499B1/en active IP Right Grant
- 2013-07-15 KR KR1020130082551A patent/KR101378888B1/en active IP Right Grant
-
2014
- 2014-07-31 KR KR20140098242A patent/KR101477771B1/en active IP Right Grant
-
2016
- 2016-02-08 JP JP2016021985A patent/JP6203878B2/en active Active
-
2017
- 2017-08-29 JP JP2017164566A patent/JP6550429B2/en active Active
-
2018
- 2018-09-04 HK HK18111299.5A patent/HK1251838A1/en unknown
- 2018-09-04 HK HK18111297.7A patent/HK1251832A1/en unknown
-
2019
- 2019-01-16 US US16/249,146 patent/US10645411B2/en active Active
- 2019-06-28 JP JP2019122135A patent/JP6783355B2/en active Active
-
2020
- 2020-03-25 US US16/830,236 patent/US12003753B2/en active Active
- 2020-10-12 JP JP2020171894A patent/JP7369679B2/en active Active
-
2022
- 2022-11-22 JP JP2022186903A patent/JP2023018075A/en active Pending
Patent Citations (63)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
RU2106759C1 (en) | 1992-02-21 | 1998-03-10 | Ар-Си-Эй Томсон Лайсензинг Корпорейшн | High definition tv receiver with low resolution |
US5262854A (en) | 1992-02-21 | 1993-11-16 | Rca Thomson Licensing Corporation | Lower resolution HDTV receivers |
JPH1188888A (en) | 1997-06-25 | 1999-03-30 | Nippon Telegr & Teleph Corp <Ntt> | Method for predictively encoding moving vector, method for decoding moving vector, predictively encoding device, decoding device, and recording medium recording predictively encoding program and decoding program for moving vector |
EP0921688A1 (en) | 1997-06-25 | 1999-06-09 | Nippon Telegraph and Telephone Corporation | Moving vector predictive coding method and moving vector decoding method, predictive coding device and decoding device, and storage medium stored with moving vector predictive coding program and moving vector decoding program |
US20030174776A1 (en) * | 1997-06-25 | 2003-09-18 | Nippon Telegraph And Telephone Corporation | Motion vector predictive encoding method, motion vector decoding method, predictive encoding apparatus and decoding apparatus, and storage media storing motion vector predictive encoding and decoding programs |
CN1154344C (en) | 1997-10-16 | 2004-06-16 | 松下电器产业株式会社 | Method for reducing demand of video frequency decoder processing ability |
JPH11122624A (en) | 1997-10-16 | 1999-04-30 | Matsushita Electric Ind Co Ltd | Method and system for reducing video decoder processing amount |
US6389071B1 (en) | 1997-10-16 | 2002-05-14 | Matsushita Electric Industrial Co., Ltd. | Method for reducing processing power requirements of a video decoder |
US20020080874A1 (en) | 1997-10-16 | 2002-06-27 | Matsushita Electric Industrial Co., Ltd. | Method for reducing processing power requirements of a video decoder |
KR20040035777A (en) | 2001-09-12 | 2004-04-29 | 코닌클리케 필립스 일렉트로닉스 엔.브이. | Motion estimation and/or compensation |
US20040105589A1 (en) | 2001-12-25 | 2004-06-03 | Makoto Kawaharada | Moving picture compression/coding apparatus and motion vector detection method |
KR20040016856A (en) | 2001-12-25 | 2004-02-25 | 마츠시타 덴끼 산교 가부시키가이샤 | Moving picture compression/coding apparatus and motion vector detection method |
US20030133512A1 (en) | 2002-01-11 | 2003-07-17 | Shankar Moni | Spatially transcoding a video stream |
US20040234143A1 (en) * | 2002-07-02 | 2004-11-25 | Makoto Hagai | Image encoding method and picture decoding method |
US6982663B2 (en) | 2002-07-10 | 2006-01-03 | Lsi Logic Corporation | Method and system for symbol binarization |
JP2005533468A (en) | 2002-07-17 | 2005-11-04 | ディリティアム ネットワークス ピーティーワイ リミテッド | Method and apparatus for transform coding between hybrid video codec bitstreams |
KR20050026484A (en) | 2002-07-17 | 2005-03-15 | 딜리시움 네트웍스 피티와이 리미티드 | Method and apparatus for transcoding between hybrid video codec bitstreams |
WO2004008734A2 (en) | 2002-07-17 | 2004-01-22 | Dilithium Networks Pty Limited | Method and apparatus for transcoding between hybrid video codec bitstreams |
CN101090499A (en) | 2002-07-17 | 2007-12-19 | 达丽星网络有限公司 | Method and apparatus for transcoding between hybrid video codec bitstreams |
US20040057521A1 (en) | 2002-07-17 | 2004-03-25 | Macchina Pty Ltd. | Method and apparatus for transcoding between hybrid video CODEC bitstreams |
US20060133486A1 (en) | 2002-10-01 | 2006-06-22 | Thomson Licensing S.A. | Implicit weighting of reference pictures in a video decoder |
US20050013372A1 (en) | 2003-07-18 | 2005-01-20 | Microsoft Corporation | Extended range motion vectors |
US20070014359A1 (en) * | 2003-10-09 | 2007-01-18 | Cristina Gomila | Direct mode derivation process for error concealment |
RU2335859C2 (en) | 2003-12-22 | 2008-10-10 | Кэнон Кабусики Кайся | Full-motion video encoding device, method and control software for the device |
US8064521B2 (en) | 2003-12-22 | 2011-11-22 | Canon Kabushiki Kaisha | Motion image coding apparatus, and control method and program of the apparatus |
CN101379511A (en) | 2005-03-18 | 2009-03-04 | 夏普株式会社 | Methods and systems for extended spatial scalability with picture-level adaptation |
CN101379829A (en) | 2006-02-02 | 2009-03-04 | 汤姆逊许可公司 | Method and apparatus for adaptive weight selection for motion compensated prediction |
JP2009533901A (en) | 2006-04-07 | 2009-09-17 | マイクロソフト コーポレーション | Dynamic selection of motion prediction search range and extended motion vector range |
WO2007117711A2 (en) | 2006-04-07 | 2007-10-18 | Microsoft Corporation | Dynamic selection of motion estimation search ranges and extended motion vector ranges |
US20070237232A1 (en) | 2006-04-07 | 2007-10-11 | Microsoft Corporation | Dynamic selection of motion estimation search ranges and extended motion vector ranges |
US8565308B2 (en) * | 2006-08-17 | 2013-10-22 | Fujitsu Semiconductor Limited | Interframe prediction processor with address management mechanism for motion vector storage |
US20080165860A1 (en) | 2006-08-31 | 2008-07-10 | Zohair Sahraoui | H.264 Data processing |
EP1924099A1 (en) | 2006-09-08 | 2008-05-21 | Kabushiki Kaisha Toshiba | Frame interpolating circuit, frame interpolating method, and display apparatus |
US8837605B2 (en) | 2006-09-26 | 2014-09-16 | Onmobile Global Limited | Method and apparatus for compressed video bitstream conversion with reduced-algorithmic-delay |
KR20080070976A (en) | 2007-01-29 | 2008-08-01 | 삼성전자주식회사 | Method and apparatus for video encoding, and method and apparatus for video decoding |
US20100135387A1 (en) | 2007-04-12 | 2010-06-03 | Thomson Licensing | Method and apparatus for context dependent merging for skip-direct modes for video encoding and decoding |
CN101115200A (en) | 2007-04-20 | 2008-01-30 | 西安交通大学 | Effective motion vector telescopic encoding method |
US20090034618A1 (en) | 2007-08-03 | 2009-02-05 | Fu Frank | Decoding method and apparatus for block-based digitally encoded picture |
WO2009064615A1 (en) | 2007-11-15 | 2009-05-22 | General Instrument Corporation | Method and apparatus for performing motion estimation |
CN101448154A (en) | 2007-11-27 | 2009-06-03 | 联发科技股份有限公司 | Motion compensation method and integrated circuit utilizing the same |
US20090304084A1 (en) * | 2008-03-19 | 2009-12-10 | Nokia Corporation | Combined motion vector and reference index prediction for video coding |
US20160212442A1 (en) | 2008-03-19 | 2016-07-21 | Nokia Technologies Oy | Combined motion vector and reference index prediction for video coding |
CN101873483A (en) | 2009-04-24 | 2010-10-27 | 深圳市九洲电器有限公司 | Motion estimation method and coding chip and device using same |
US20100329329A1 (en) | 2009-06-24 | 2010-12-30 | Qualcomm Incorporated | 8-point transform for media data coding |
JP2011010197A (en) | 2009-06-29 | 2011-01-13 | Mitsubishi Electric Corp | Image encoder and image decoder |
KR20110017302A (en) | 2009-08-13 | 2011-02-21 | 삼성전자주식회사 | Method and apparatus for encoding/decoding image by using motion vector accuracy control |
US20120207220A1 (en) * | 2009-08-21 | 2012-08-16 | Sk Telecom Co., Ltd. | Method and apparatus for encoding/decoding images using adaptive motion vector resolution |
US20130070846A1 (en) | 2010-03-08 | 2013-03-21 | Sk Telecom Co., Ltd. | Motion vector encoding/decoding method and apparatus using a motion vector resolution combination, and image encoding/decoding method and apparatus using same |
CN101841712A (en) | 2010-04-28 | 2010-09-22 | 广西大学 | B-frame expansion direct mode oriented to panoramic video coding |
US20120134416A1 (en) * | 2010-11-29 | 2012-05-31 | Mediatek Inc. | Method and Apparatus for Derivation of MV/MVP Candidate for Inter/Skip/Merge Modes |
US20120134415A1 (en) | 2010-11-29 | 2012-05-31 | Mediatek Inc. | Method and Apparatus of Extended Motion Vector Predictor |
US9258573B2 (en) | 2010-12-07 | 2016-02-09 | Panasonic Intellectual Property Corporation Of America | Pixel adaptive intra smoothing |
US10244252B2 (en) | 2011-01-31 | 2019-03-26 | Electronics And Telecommunications Research Institute | Method and apparatus for encoding/decoding images using a motion vector |
US20130294522A1 (en) | 2011-01-31 | 2013-11-07 | Electronics And Telecommunications Research Institute | Method and apparatus for encoding/decoding images using a motion vector |
JP2018011323A (en) | 2011-01-31 | 2018-01-18 | エレクトロニクス アンド テレコミュニケーションズ リサーチ インスチチュートElectronics And Telecommunications Research Institute | Image decoding apparatus, image encoding apparatus, and recording medium |
US20190149837A1 (en) | 2011-01-31 | 2019-05-16 | Electronics And Telecommunications Research Institute | Method and apparatus for encoding/decoding images using a motion vector |
JP6783355B2 (en) | 2011-01-31 | 2020-11-11 | エレクトロニクス アンド テレコミュニケーションズ リサーチ インスチチュートElectronics And Telecommunications Research Institute | Video decoding device, video coding device and bitstream transmission method |
US20220086479A1 (en) | 2011-01-31 | 2022-03-17 | Electronics And Telecommunications Research Institute | Method and apparatus for encoding/decoding images using a motion vector |
US9307239B2 (en) * | 2011-03-14 | 2016-04-05 | Mediatek Inc. | Method and apparatus for derivation of motion vector candidate and motion vector prediction candidate |
US9609346B2 (en) * | 2011-03-14 | 2017-03-28 | Hfi Innovation Inc. | Method and apparatus for deriving temporal motion vector prediction |
US20130003849A1 (en) | 2011-07-01 | 2013-01-03 | Qualcomm Incorporated | Video coding using adaptive motion vector resolution |
US20130083853A1 (en) | 2011-10-04 | 2013-04-04 | Qualcomm Incorporated | Motion vector predictor candidate clipping removal for video coding |
US20130128976A1 (en) | 2011-11-18 | 2013-05-23 | FUJITSU LlMITED | Method of coding moving image and method of decoding moving image |
Non-Patent Citations (73)
Title |
---|
"Text of ISO/IEC 14496-2 (MPEG-4 Visual) 2001 Edition", 57, MPEG Meeting; Sydney; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. N4350 Section 7.8.7.3. |
An et al., "CU Level Directional Merge Mode", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 4th Meeting, Daegu, KR, Jan. 20-28, 2011. |
Anonymous (Text of ISO/IEC MPEG-4 Visual) 2011 Edition, MPEG Meeting; Sydney, No. N4350, Jul. 30, 2011, Sectino 7.8.7.3. * |
AVC Standard ITU-T Recommendation H.264, Series H: Audiovisual And Multimedia Systems, Infrastructure Of Audiovisual Services—Coding Of Moving Video, Mar. 2005. |
Brazillian Patent Office, Application No. BR112013019495-2, Office Action dated Apr. 28, 2020. |
Bross et al. "BoG report of CE9: MV Coding and Skip/Merge operations" Document: JCTVC-E481, Mar. 23, 2011. * |
Bross et al. "WD3: Working Draft 3 of High-Efficiency Video Coding" Document: JCTVC-E603, Mar. 30, 2011. * |
Canada Patent Office, Application No. 3050903, Office Action dated Sep. 18, 2020. |
Certified Translation Of Korean Application No. KR 10-2011-0009636 Filed Jan. 31, 2011. |
Certified Translation Of Korean Application No. KR-10-2011-0019166 Filed Mar. 3, 2011. |
Certified Translation Of Korean Application No. KR-10-2011-0050853 Filed May 27, 2011. |
Chinese Patent Office, Application No. 2012800157098, Office Action dated May 1, 2016. |
Declaration Of Joseph P. Havlicek, Ph.D. In Support Of Request For Ex Parte Reexamination Of U.S. Pat. No. 10,244,252. |
Declaration Of Stephan Wenger In Support Of Request For Ex Parte Reexamination Of U.S. Pat. No. 10,244,252 (Part 1 Of 3). |
Declaration Of Stephan Wenger In Support Of Request For Ex Parte Reexamination Of U.S. Pat. No. 10,244,252 (Part 2 Of 3). |
Declaration Of Stephan Wenger In Support Of Request For Ex Parte Reexamination Of U.S. Pat. No. 10,244,252 (Part 3 Of 3). |
European Patent Office, Application No. 12742304.4, Extended Search Report dated Dec. 19, 2014. |
European Patent Office, Application No. 12742304.4, Notice of Opposition dated Jul. 20, 2022. |
European Patent Office, Application No. 12742304.4, Oral Hearing Summons dated Apr. 28, 2023. |
European Patent Office, Application No. 12742304.4, Oral Hearing Summons dated Feb. 9, 2024. |
Francois et al. "On memory compression for motion vector prediction", JCTVC-E221, Mar. 2011. * |
Francois et al., "On Memory Compression for Motion Vector Prediction", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting, Geneva, CH, Mar. 16-23, 2011. |
Iain E. Richardson, "The H.264 Advanced Video Compression Standard, Second Edition", Particularly Sections 6.4 'Inter Prediction) And 6.6 (Summary) Of Chapter 6 (H.264 Prediction); 2010 John Wiley & Sons, Ltd.; ISBN: 9780470516928. |
Image File Wrapper Of U.S. Appl. No. 13/979,214 Filed 2013-07-11 (Part 1 Of 3). |
Image File Wrapper Of U.S. Appl. No. 13/979,214 Filed 2013-07-11 (Part 2 Of 3). |
Image File Wrapper Of U.S. Appl. No. 13/979,214 Filed 2013-07-11 (Part 3 Of 3). |
Japanese Patent Office, Application No. 2013-551919, Office Action dated Aug. 14, 2015. |
Japanese Patent Office, Application No. 2016-122135, Office Action dated Jun. 16, 2020. |
Japanese Patent Office, Application No. 2020-171894, Office Action dated Oct. 5, 2021. |
Japanese Patent Office, Application No. 2022-186903, Office Action dated Jan. 5, 2024. |
JCTVC-E059 (Version 4), Modification Of Temporal MV Memory Compression And Temporal MV Predictor, Joint Collaborative Team On Video Coding (JCT-VC) Of ITU-T SG16 WP3 And ISO/IEC JCT1/SC29/WG11 (5th Meeting: Geneva, CH, Mar. 16-23, 2011) ("JCTVC-E059"). |
JCTVC-E481 (Version 4), BoG Report Of DE9: MV Coding And Skip/Merge Operation, Joint Collaborative Team On Video Coding (JCT-VC) Of ITU-T SG16 WP And ISO/IEC JCT1/SC29/WG11 (5th Meeting: Geneva, CH, Mar. 16-23, 2011). |
JCTVC-E603 (Version 1), WD3: Working Draft 3 Of High-Efficiency Video Coding, Joint Collaborative Team On Video Coding (JCT-VC) Or ITU-T SG16 WP 3 And ISO/IEC JTC1/SC29/WG11 (5th Meeting: Geneva, CH, Mar. 16-23, 2011). |
Ji et al., "New Scaling Technique For Direct Mode Coding In B Pictures" Institute Of Computing Technology, 2004. |
Jung et al., "Temporal MV Predictor Modification for MF-Comp, Skip, Direct and Merge Schemes", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 4th Meeting, Daegu, KR, Jan. 20-28, 2011. |
Korean Patent Office, Application No. 10-2012-0010096, Notice of Allowance dated May 2, 2014. |
Korean Patent Office, Application No. 10-2012-0010096, Office Action dated Sep. 23, 2013. |
Lim et al., "Dynamic Range Restriction Of Temporal Motion Vector", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting, Geneva, CH, Mar. 16-23, 2011. |
Lin et al., "Improved Advanced Motion Vector Prediction", Joint Collaborative Team On Video Coding (JCT-VC) Of ITU-T SG16 WP3 And ISO/IEC JTC1/SC29/WG11, 4th Meeting: Daegu, KR, Jan. 20-28, 2011, Document: JCTVC-D125. |
Park et al., "Modifications of Temporal MV Memory Compression and Temporal MV Predictor", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting, Geneva, CH, Mar. 16-23, 2011. |
Request For Ex Parte Reexamination Of U.S. Pat. No. 10,244,252 Filed Oct. 29, 2021. |
Russian Patent Office, Application No. 2013140464/08, Notice of Allowance dated Mar. 1, 2016. |
Su et al. "CE9: Reduced resolution storage of motion vector data", JCTVC-D072, Jan. 2011. * |
Su et al. "On motion vector competition" Document: JCTVC-C257, Oct. 15, 2010. * |
Su et al., (Sharp), CE9: Reduced Resolution Storage Of Motion Vector Data, JCTVC-D072, WG11 No. M18822 (Jan. 20, 2011). |
Su et al., (Sharp), On Motion Vector Competition, JCTVC-C257, WG11 No. M18298 (Oct. 2010). |
Su et al., "CE9: Reduced Resolbution Storage of Motion Vector Data", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 4th Meeting, Daegu, KR, Jan. 20-28, 2011. |
Sullivan et al., "(Draft) Report of 6th JVT Meeting, Awaji Island, Japan, Dec. 5-13, 2002", Joint Video Team (JCT) of ISO/IEC MPEG & ITU-T VCEG (ISO/IEC JTC1/SC29/WG11 and ITU-T SG16 Q.6), 6th Meeting, Awaji, Island, JP, Dec. 5-13, 2002. |
Suzuki et al., "CE9: 3.1 PU Merge & Skip Tools and Proposed Improvements", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 4th Meeting, Daegu, KR, Jan. 20-28, 2011. |
Tan et al., "Merge/Skip/Direct Simplification", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 4th Meeting, Daegu, KR, Jan. 20-28, 2011. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Advisory Action dated Aug. 16, 2017. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Advisory Action dated Mar. 23, 2016. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Final Office Action dated Apr. 25, 2018. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Final Office Action dated Jun. 13, 2017. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Final Office Action dated Oct. 21, 2015. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Non-Final Office Action dated Feb. 21, 2017. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Non-Final Office Action dated Jan. 19, 2018. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Non-Final Office Action dated Jun. 29, 2015. |
United States Patent and Trademark Office, U.S. Appl. No. 13/979,214, Notice of Allowance dated Dec. 6, 2018. |
United States Patent and Trademark Office, U.S. Appl. No. 16/249,146, Notice of Allowance dated Jan. 21, 2020. |
United States Patent and Trademark Office, U.S. Appl. No. 17/538,797, Final Office Action dated Dec. 22, 2022. |
United States Patent and Trademark Office, U.S. Appl. No. 17/538,797, Final Office Action dated Jun. 14, 2023. |
United States Patent and Trademark Office, U.S. Appl. No. 17/538,797, Non-Final Office Action dated Aug. 24, 2023. |
United States Patent and Trademark Office, U.S. Appl. No. 17/538,797, Non-Final Office Action dated Mar. 17, 2023. |
United States Patent and Trademark Office, U.S. Appl. No. 17/538,797, Non-Final Office Action dated Oct. 7, 2022. |
United States Patent and Trademark Office, U.S. Appl. No. 90/019,030, Ex Parte Reexamination Office Action dated Feb. 17, 2022. |
Weigand et al., Overview Of The H 264/AVC Video Coding Statement, IEEE Transactions On Circuits And Systems For Video Technology, pp. 1-19, Jul. 2003. |
Wiegand et al., "WD1: Working Draft 1 of High-Efficiency Video Coding", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 3rd Meeting, Guangzhou, CN, Oct. 7-15, 2010. |
Wiegand et al., "WD2: Working Draft 2 of High-Efficiency Video Coding", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 4th Meeting, Daegu, KR, Jan. 20-28, 2011. |
Wiegand et al., "WD3: Working Draft 3 of High-Efficiency Video Coding", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting, Geneva, CH, Mar. 16-23, 2011. |
World Intellectual Property Organization, Application No. PCT/KR2012/000770, International Search Report dated Sep. 24, 2012. |
Yeo et al., "Simplified AMVP Condidate Derivation for Inter and Merge Modes", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting, Geneva, CH, Mar. 16-23, 2011. |
Zheng et al., "Unified Motion Vector Predictor Selection Form Merge and AMVP", Joint Collaborative Team On Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTC1/SC29/WG11, 5th Meeting, Geneva, Mar. 16-23, 2011. |
Also Published As
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US12003753B2 (en) | Method and apparatus for encoding/decoding images using a motion vector | |
US9503720B2 (en) | Motion vector coding and bi-prediction in HEVC and its extensions | |
US9532042B2 (en) | Inter-prediction method and apparatus for same | |
KR101623507B1 (en) | Implicit determination of collocated picture for temporal prediction | |
US11706423B2 (en) | Inter-prediction method and apparatus for same | |
KR101428030B1 (en) | Video decoding apparatus using motion vector | |
US12028545B2 (en) | Method and apparatus for encoding/decoding images using a motion vector |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
AS | Assignment |
Owner name: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE, KOREA, REPUBLIC OF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LIM, SUNG CHANG;KIM, HUI YONG;JEONG, SE YOON;AND OTHERS;REEL/FRAME:056795/0356 Effective date: 20130612 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
ZAAA | Notice of allowance and fees due |
Free format text: ORIGINAL CODE: NOA |
|
ZAAB | Notice of allowance mailed |
Free format text: ORIGINAL CODE: MN/=. |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
ZAAA | Notice of allowance and fees due |
Free format text: ORIGINAL CODE: NOA |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE AFTER FINAL ACTION FORWARDED TO EXAMINER |
|
AS | Assignment |
Owner name: DOLBY LABORATORIES LICENSING CORPORATION, CALIFORNIA Free format text: LICENSE;ASSIGNOR:ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE;REEL/FRAME:065860/0793 Effective date: 20221130 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NOTICE OF ALLOWANCE MAILED -- APPLICATION RECEIVED IN OFFICE OF PUBLICATIONS |
|
ZAAB | Notice of allowance mailed |
Free format text: ORIGINAL CODE: MN/=. |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: AWAITING TC RESP., ISSUE FEE NOT PAID |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |