US10911773B2 - Motion vector difference coding and decoding - Google Patents
Motion vector difference coding and decoding Download PDFInfo
- Publication number
- US10911773B2 US10911773B2 US16/097,344 US201716097344A US10911773B2 US 10911773 B2 US10911773 B2 US 10911773B2 US 201716097344 A US201716097344 A US 201716097344A US 10911773 B2 US10911773 B2 US 10911773B2
- Authority
- US
- United States
- Prior art keywords
- mvd
- mvd component
- motion vector
- component
- xor
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active, expires
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/46—Embedding additional information in the video signal during the compression process
- H04N19/467—Embedding additional information in the video signal during the compression process characterised by the embedded information being invisible, e.g. watermarking
Definitions
- Embodiments herein relate to the field of video coding, such as High Efficiency Video Coding (HEVC) or the like.
- HEVC High Efficiency Video Coding
- embodiments herein relate to a method and a video encoder for encoding a motion vector, wherein the motion vector is represented by a sum of a motion vector prediction (MVP) and a motion vector difference (MVD) between the motion vector and the MVP.
- Embodiments herein relate to a method and a video decoder for reconstructing a motion vector from a motion vector prediction (MVP) and a motion vector difference (MVD).
- MVP motion vector prediction
- MVD motion vector difference
- Corresponding computer programs therefor are also disclosed.
- High Efficiency Video Coding also known as H.265
- HEVC High Efficiency Video Coding
- ITU-T International Telecommunications Union
- MPEG Moving Pictures Experts Group
- coding unit coding unit
- CU coding unit
- Each unit can be further partitioned into smaller blocks for spatial or temporal prediction. Up to 4 symmetric and 4 asymmetric partition structures are supported for better capturing characteristics for different video content.
- Spatial prediction which is also called intra prediction, is achieved by predicting current block using previous decoded blocks within the same picture.
- a picture consisting of only intra-predicted blocks is referred as an I-picture.
- I-pictures do not have any dependency on any other pictures, they provide starting points for encoding or decoding. Therefore, the first picture inside a video sequence is typically encoded as an I-picture.
- Temporal prediction also known as inter prediction, is achieved by predicting blocks in a current picture using blocks from previous decoded pictures, the so-called reference pictures, along with motion vectors indicating the movement between the pictures.
- Temporal prediction is achieved using inter (P) prediction, i.e., prediction from one block in one reference picture, or bi-directional inter (B) prediction, i.e. prediction from blending of two blocks in one or two reference pictures.
- P inter
- B bi-directional inter
- a picture containing only P-predicted blocks is referred as a P-picture.
- a picture that contains at least one bi-predicted block is referred as a B-picture.
- reference pictures When encoding a picture, it is possible to have several reference pictures. These reference pictures are grouped into two lists. The reference pictures that are displayed before the current picture are usually grouped into list 0 while the reference pictures that are displayed after the current picture are usually grouped into list 1. For signaling the usage of a specific reference picture for current block, a reference picture list flag and a reference picture index are needed to be encoded.
- the reference picture list flag specifies which reference picture list to use, while the reference picture index specifies the targeted reference picture's index inside the list.
- MV motion vector
- Each MV consists of x and y components that signal the displacements between current block and the referenced block.
- the MV may point to full-pel (full-pixel), half-pel (half-pixel) and quarter-pel (quarter-pixel) samples.
- Half-pel and quarter-pel samples are generated by interpolating their corresponding neighboring full-pel samples.
- MVs can constitute up to about 50% of the total bitrate.
- a common motion vector prediction process begins with constructing a list of neighboring MVs which is referred to as MVP list, selects one of them as motion vector predictor (MVP) and then calculates the motion vector difference (MVD) between the predictor and current MV. Therefore, instead of encoding a “full” MV, only the MVP index which tells the index of the selected MVP inside the MVP list and the corresponding MVD are encoded.
- MVP list a list of neighboring MVs which is referred to as MVP list
- MVP motion vector predictor
- MVD motion vector difference
- the current MV ( ⁇ 2,4) is to be predicted from a list of two MVP candidates: a MV with index 0 and having a value (24,9) and a MV with index 1 and having a value ( ⁇ 4,7). As the current MV is closer to the MV with index 1, the MV with index 1 is chosen as the MVP candidate. What is being encoded is the MVP index 1 and the MVD (2, ⁇ 3), i.e., the difference between the current MV ( ⁇ 2, 4) and the MVP candidate ( ⁇ 4,7). As shown in the figure, the MVD has x and y components. Each of them consists of two parts: magnitude part and sign part. These two parts are usually encoded separately.
- a first aspect of the embodiments defines a method performed by a video encoder, for encoding a motion vector, wherein the motion vector is represented by a sum of a motion vector prediction (MVP) and a motion vector difference (MVD) between the motion vector and the MVP.
- the MVD comprises a first MVD component y and a second MVD component x.
- the method comprises encoding the first MVD component y.
- the method comprises encoding a representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the method comprises sending information to a video decoder on how reconstruct the second MVD component x from the representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- a second aspect of the embodiments defines a video encoder, for encoding a motion vector, wherein the motion vector is represented by a sum of a motion vector prediction (MVP) and a motion vector difference (MVD) between the motion vector and the MVP.
- the MVD comprises a first MVD component y and a second MVD component x.
- the video encoder comprises processing means operative to encode the first MVD component y.
- the video encoder comprises processing means operative to encode a representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the video encoder comprises processing means operative to send information to a video decoder on how reconstruct the second MVD component x from the representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- a third aspect of the embodiments defines a computer program, for encoding a motion vector, wherein the motion vector is represented by a sum of a motion vector prediction (MVP) and a motion vector difference (MVD) between the motion vector and the MVP.
- the MVD comprises a first MVD component y and a second MVD component x.
- the computer program comprises code means which, when run on a computer, causes the computer to encode the first MVD component y.
- the computer program comprises code means which, when run on a computer, causes the computer to encode a representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the computer program comprises code means which, when run on a computer, causes the computer to send information to a video decoder on how reconstruct the second MVD component x from the representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- a fourth aspect of the embodiments defines a computer program product comprising computer readable means and a computer program according to the third aspect, stored on the computer readable means.
- a fifth aspect of the embodiments defines a method, performed by a video decoder, for reconstructing a motion vector from a motion vector prediction (MVP) and a motion vector difference (MVD).
- the MVD comprises a first MVD component y and a second MVD component x.
- the method comprises receiving information from a video encoder on how to reconstruct the second MVD component x from a representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- the method comprises decoding the first MVD component y.
- the method comprises decoding the representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the method comprises reconstructing the second MVD component x in accordance with the received information.
- a sixth aspect of the embodiments defines a video decoder, for reconstructing a motion vector from a motion vector prediction (MVP) and a motion vector difference (MVD).
- the MVD comprises a first MVD component y and a second MVD component x.
- the video decoder comprises processing means operative to receive information from a video encoder on how to reconstruct the second MVD component x from a representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- the video decoder comprises processing means operative to decode the first MVD component y.
- the video decoder comprises processing means operative to decode the representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the video decoder comprises processing means operative to reconstruct the second MVD component x in
- a seventh aspect of the embodiments defines a computer program, for reconstructing a motion vector from a motion vector prediction (MVP) and a motion vector difference (MVD).
- the MVD comprises a first MVD component y and a second MVD component x.
- the computer program comprises code means which, when run on a computer, causes the computer to receive information from a video encoder on how to reconstruct the second MVD component x from a representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- the computer program comprises code means which, when run on a computer, causes the computer to decode the first MVD component y.
- the computer program comprises code means which, when run on a computer, causes the computer to decode the representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the computer program comprises code means which, when run on a computer, causes the computer to reconstruct the second MVD component x in accordance with the received information.
- An eight aspect of the embodiments defines a computer program product comprising computer readable means and a computer program according to the seventh aspect, stored on the computer readable means.
- At least some of the embodiments provide a reduced bitrate, without introducing noticeable decoding complexity.
- any feature of the first, second, third, fourth, fifth, sixth, seventh and eighth aspects may be applied to any other aspect, whenever appropriate.
- any advantage of the first aspect may equally apply to the second, third, fourth, fifth, sixth, seventh and eighth aspect respectively, and vice versa.
- FIG. 1 illustrates an example of motion vector prediction according to the prior art.
- FIG. 2 illustrates the steps performed in an encoding method according to the embodiments of the present invention.
- FIGS. 3 (A) and (B) illustrate examples of motion vector search patterns according to an embodiment of the present invention.
- FIG. 4 illustrates a motion vector search pattern according to an embodiment of the present invention.
- FIG. 5 illustrates the steps performed in a decoding method according to the embodiments of the present invention.
- FIG. 6 depicts a schematic block diagram illustrating functional units of a video encoder for encoding a motion vector according to embodiments of the present invention.
- FIG. 7 illustrates a schematic block diagram illustrating a computer comprising a computer program product with a computer program for encoding a motion vector, according to embodiments of the present invention.
- FIG. 8 depicts a schematic block diagram illustrating functional units of a video decoder for reconstructing a motion vector, according to an embodiment of the present invention.
- FIG. 9 illustrates a schematic block diagram illustrating a computer comprising a computer program product with a computer program for reconstructing a motion vector, according to an embodiment of the present invention.
- the present embodiments generally relate to a method and an encoder for encoding a motion vector, wherein the motion vector is represented by a sum of a motion vector prediction and a motion vector difference between the motion vector and the MVP, as well as a method and a decoder for reconstructing a motion vector from a motion vector prediction and a motion vector difference.
- a method, performed by a video encoder, for encoding a motion vector is provided, as described in FIG. 2 .
- the motion vector is represented by a sum of a motion vector prediction (MVP) and a motion vector difference (MVD) between the motion vector and the MVP.
- the MVD comprises a first MVD component y and a second MVD component x.
- the method comprises a step S 1 of encoding the first MVD component y.
- the first MVD component y may, for example, be encoded as is currently done in HEVC.
- the method comprises a step S 2 of encoding a representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the representation ⁇ circumflex over (x) ⁇ may be a reduced size version of the second MVD component x, i.e., may carry a part of the second MVD component x. For example, it may be an incomplete version of x, obtained by removing at least one bit of the second MVD component x.
- the representation may contain all but the least significant bit of the second MVD component, in which case the parity of the second MVD component is removed, or all but the most significant bit of the second MVD component, in which case the sign of the MVD component is removed and the representation corresponds to the magnitude of the second MVD component. More details about the representation ⁇ circumflex over (x) ⁇ will be given below.
- the method comprises a step S 3 of sending information to a video decoder on how reconstruct the second MVD component x from the representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- This in principle means that the representation ⁇ circumflex over (x) ⁇ is created in such a way that the second MVD component x can be reconstructed from ⁇ circumflex over (x) ⁇ and at least one of: the first MVD component y and syntax elements such as MVP index, reference picture index, reference picture list flag, block partition size, block partition type etc.
- Sending this information ensures identical reconstruction at the video decoder.
- the video decoder is this way informed about how the reconstruction of the second MVD component and the MVD accordingly needs to be performed, i.e., which parts of the MVD components and syntax elements are used and what operation needs to be performed on them.
- each aforementioned syntax elements are as follows: MVP index specifies the MVP candidate index in a MVP list; reference picture list flag specifies which reference picture list of usage, i.e. list 0 or list 1; reference picture index specifies the index of the targeted reference picture inside the reference picture list; block partition size specifies the partitioning size and block partition type specifies the partitioning structure.
- these elements contain various prediction information for an inter-coded block. Therefore, it gives the video encoder additional freedom of deciding a best way to represent ⁇ circumflex over (x) ⁇ by selectively using these syntax elements.
- the identical reconstruction needs to be performed at both the video encoder and the video decoder in order to correctly reconstruct the second MVD component x.
- Sending (signaling) information may be done, but is not limited to, by using a sequence parameter set (SPS), picture parameter set (PPS) or video parameter set (VPS).
- SPS sequence parameter set
- PPS picture parameter set
- VPS video parameter set
- the information may also be sent “offline”, i.e., the video encoder and the video decoder may exchange in advance the details of the reconstruction process.
- the representation ⁇ circumflex over (x) ⁇ of the second MVD component x corresponds to a magnitude of the second MVD component x.
- Magnitude(x) and Magnitude(y) respectively refer to the magnitudes of the second and first MVD components
- PartSize and RefIdx refer to refers to a block partition size and a reference picture index, as described above.
- ‘AND 0x01’ in the expression above means that only the last bit of the operation (Magnitude(x)XOR Magnitude(y)XOR PartSize XOR RefIdx) is taken as the Sign(x).
- Sign(x) may also be referred to as the most significant bit of x, or MSB(x).
- the sign of the second MVD component x is not encoded, i.e., it is not sent to a video decoder. Instead, Sign(x) is reconstructed at the decoder from the sent information that tells to use the expression above. Not encoding a bit of the second MVD component, while knowing how to reconstruct it, results in bitrate savings. This also implies that the reconstruction process of the second MVD component, according to this embodiment, needs to be identical at the video encoder and the video decoder side, as mentioned above.
- the representation ⁇ circumflex over (x) ⁇ of the second MVD component x comprises all but the least significant bit of the second MVD component x, LSB(x).
- ‘AND 0x01’ in the expression above means that only the last bit of the operation LSB(y) XOR MVPindex is taken as LSB(x). The same operation is performed at the video encoder and the video decoder, so that the least significant bit of the second MVD component x does not need to be sent.
- This embodiment may also be generalized such that a bit other than the LSB is embedded in a corresponding bit from the first MVD component.
- the representation ⁇ circumflex over (x) ⁇ of the second MVD component x comprises all but the least significant bit of the second MVD component x, LSB(x).
- this embodiment may also be generalized such that a bit other than the LSB is embedded in a corresponding bit from the first MVD component.
- the second MVD component's least significant bit 0 can be derived using the parity of the first MVD component. Thus, only (2, ⁇ 8) will be encoded.
- Another alternative is to embed the second MVD component's LSB using the inverse parity of the first MVD component y.
- a motion search pattern as shown in FIG. 3(B) may be applied on the encoder side.
- this embodiment may also be generalized to use other bit than the LSB to be embedded in a corresponding bit from another motion vector component.
- the procedure when reconstructing, instead of always multiplying the second MVD component's magnitude by two and adding the LSB of the first MVD component's magnitude, the procedure depends on the value of the second MVD component. For example, when this value is 0, no modification is made. When the value is smaller than 0, it is multiplied by 2 and the LSB of the first component's magnitude is added. When it is larger than 0, it is multiplied by 2, and the inverse of the LSB of the y component's magnitude is subtracted.
- a motion vector search pattern as shown in FIG. 4 may be applied by the video encoder. The benefit of this is that the commonly used motion vectors (0,0), (0,1), (1,0), (0, ⁇ 1) and ( ⁇ 1,0) can be all used and reconstructed, which leads to slightly better overall compression.
- this embodiment may also be generalized to use a bit other than the LSB to be embedded in a corresponding bit from another MVD component.
- a method, performed by a video decoder, for reconstructing a motion vector from a motion vector prediction and a motion vector difference is provided, as illustrated in FIG. 5 .
- the MVD comprises a first MVD component y and a second MVD component x.
- the method comprises a step S 4 of receiving information from a video encoder on how to reconstruct the second MVD component x from a representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type. This ensures a correct reconstruction of the second MVD component x.
- the received information may be signaled by using a sequence parameter set, picture parameter set or video parameter set, as mentioned above.
- the video encoder and the video decoder may as well exchange in advance the details of the reconstruction process.
- the method comprises a step S 5 of decoding the first MVD component y.
- the method further comprises a step S 6 of decoding the representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the representation ⁇ circumflex over (x) ⁇ may be a reduced size version of the second MVD component x and may, for example, be obtained by removing at least one bit of the second MVD component x.
- the representation may contain all but the least significant bit of the second MVD component, in which case the parity of the second MVD component is removed, or all but the most significant bit of the second MVD component, in which case the sign of the MVD component is removed and the representation corresponds to the magnitude of the second MVD component.
- the method further comprises a step S 7 of reconstructing the second MVD component x in accordance with the received information.
- the representation ⁇ circumflex over (x) ⁇ of the second MVD component x corresponds to a magnitude of the second MVD component x
- the reconstruction process in this embodiment is identical to the one described in the first encoder embodiment. For more details, please refer to the related section above.
- the representation ⁇ circumflex over (x) ⁇ of the second MVD component x comprises all but the least significant bit of the second MVD component x, LSB(x).
- the representation ⁇ circumflex over (x) ⁇ of the second MVD component x comprises all but the least significant bit of the second MVD component x, LSB(x).
- the representation ⁇ circumflex over (x) ⁇ of the second MVD component x comprises all but the least significant bit of the second MVD component x, LSB(x).
- FIG. 6 is a schematic block diagram of a video encoder 100 , for encoding a motion vector, wherein the motion vector is represented by a sum of a motion vector prediction and a motion vector difference between the motion vector and the MVP.
- the MVD comprises a first MVD component y and a second MVD component x.
- the video encoder 100 comprises, according to this aspect, an encoding unit 160 , configured to encode the first MVD component y and to encode a representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the video encoder 100 comprises, according to this aspect, a sending unit 170 , configured to send information to a video decoder on how reconstruct the second MVD component x from the representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- the encoding 160 and sending 170 units may be hardware based, software based (in this case they are called encoding and sending modules respectively) or may be a combination of hardware and software.
- the encoder 100 may be an HEVC encoder or any other state of the art or future video encoder.
- the video encoder 100 can be implemented in hardware, in software or a combination of hardware and software.
- the video encoder 100 can be implemented in user equipment, such as a mobile telephone, tablet, desktop, netbook, multimedia player, video streaming server, set-top box or computer.
- the video encoder 100 may also be implemented in a network device in the form of or connected to a network node, such as radio base station, in a communication network or system.
- FIG. 6 Although the respective units disclosed in conjunction with FIG. 6 have been disclosed as physically separate units in the device, where all may be special purpose circuits, such as ASICs (Application Specific Integrated Circuits), alternative embodiments of the device are possible where some or all of the units are implemented as computer program modules running on a general purpose processor. Such an embodiment is disclosed in FIG. 7 .
- ASICs Application Specific Integrated Circuits
- FIG. 7 schematically illustrates an embodiment of a computer 150 having a processing unit 110 such as a DSP (Digital Signal Processor) or CPU (Central Processing Unit).
- the processing unit 110 can be a single unit or a plurality of units for performing different steps of the method described herein.
- the computer also comprises an input/output (I/O) unit 120 for receiving a video sequence.
- the I/O unit 120 has been illustrated as a single unit in FIG. 6 but can likewise be in the form of a separate input unit and a separate output unit.
- the computer 150 comprises at least one computer program product 130 in the form of a non-volatile memory, for instance an EEPROM (Electrically Erasable Programmable Read-Only Memory), a flash memory or a disk drive.
- the computer program product 130 comprises a computer program 140 , which comprises code means which, when run on the computer 150 , such as by the processing unit 110 , causes the computer 150 to perform the steps of the method described in the foregoing in connection with FIG. 2 .
- FIG. 8 is a schematic block diagram of a video decoder 200 for reconstructing a motion vector from a motion vector prediction and a motion vector difference, wherein the motion vector difference comprises a first MVD component y and a second MVD component x.
- the video decoder 200 comprises, according to this aspect, a receiving unit 260 , configured to receive information from a video encoder 100 on how to reconstruct the second MVD component x from a representation ⁇ circumflex over (x) ⁇ of the second MVD component x and at least one of: the first MVD component y, MVP index MVPindex, reference picture index RefIdx, reference picture list flag, block partition size PartSize and block partition type.
- the video decoder 200 comprises, according to this aspect, a decoding unit 270 , configured to decode the first MVD component y and to decode the representation ⁇ circumflex over (x) ⁇ of the second MVD component x.
- the video decoder comprises, according to this aspect, a reconstructing unit 280 , configured to reconstruct the second MVD component x in accordance with the received information.
- the receiving 260 , decoding 270 and reconstructing 280 units may be hardware based, software based (in this case they are called receiving, decoding and reconstructing modules respectively) or may be a combination of hardware and software.
- the video decoder 200 may be an HEVC decoder or any other state of the art or future video decoder.
- the video decoder 200 can be implemented in hardware, in software or a combination of hardware and software.
- the video decoder 200 can be implemented in user equipment, such as a mobile telephone, tablet, desktop, netbook, multimedia player, video streaming server, set-top box or computer.
- the video decoder 200 may also be implemented in a network device in the form of or connected to a network node, such as radio base station, in a communication network or system.
- FIG. 8 Although the respective units disclosed in conjunction with FIG. 8 have been disclosed as physically separate units in the device, where all may be special purpose circuits, such as ASICs (Application Specific Integrated Circuits), alternative embodiments of the device are possible where some or all of the units are implemented as computer program modules running on a general purpose processor. Such an embodiment is disclosed in FIG. 9 .
- ASICs Application Specific Integrated Circuits
- FIG. 9 schematically illustrates an embodiment of a computer 250 having a processing unit 210 such as a DSP (Digital Signal Processor) or CPU (Central Processing Unit).
- the processing unit 210 can be a single unit or a plurality of units for performing different steps of the method described herein.
- the computer also comprises an input/output (I/O) unit 220 for receiving a video bitstream.
- the I/O unit 220 has been illustrated as a single unit in FIG. 9 but can likewise be in the form of a separate input unit and a separate output unit.
- the computer 250 comprises at least one computer program product 230 in the form of a non-volatile memory, for instance an EEPROM (Electrically Erasable Programmable Read-Only Memory), a flash memory or a disk drive.
- the computer program product 230 comprises a computer program 240 , which comprises code means which, when run on the computer 250 , such as by the processing unit 210 , causes the computer 250 to perform the steps of the method described in the foregoing in connection with FIG. 5 .
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
Description
Sign(x)=(Magnitude(x)XOR Magnitude(y)XOR Part Size XOR RefIdx) AND 0x01,
wherein XOR is an exclusive OR logical operation, and AND is a logical AND operation. In this expression, Magnitude(x) and Magnitude(y) respectively refer to the magnitudes of the second and first MVD components, and PartSize and RefIdx refer to refers to a block partition size and a reference picture index, as described above. ‘AND 0x01’ in the expression above means that only the last bit of the operation (Magnitude(x)XOR Magnitude(y)XOR PartSize XOR RefIdx) is taken as the Sign(x). Sign(x) may also be referred to as the most significant bit of x, or MSB(x).
LSB(x)=(LSB(y)XOR MVPindex) AND 0x01.
x=2{circumflex over (x)}+((LSB(y)XOR MVPindex) AND 0x01).
LSB(x)=(LSB(y)XOR MVPindex XOR RefIdx XOR PartSize) AND 0x01.
x=2{circumflex over (x)}+(LSB(y)XOR MVPindex XOR RefIdx XOR PartSize) AND 0x01.
LSB(x)=LSB(y).
x=2{circumflex over (x)}+LSB(y).
Sign(x)=(Magnitude(x)XOR Magnitude(y)XOR PartSize XOR RefIdx) AND 0x01.
x=2{circumflex over (x)}+((LSB(y)XOR MVPindex) AND 0x01).
x=2{circumflex over (x)}+((LSB(y)XOR MVPindex XOR RefIdx XOR PartSize) AND 0x01).
x=2{circumflex over (x)}+LSB(y).
Sign(x)=(Magnitude(x)XOR Magnitude(y)XOR PartSize XOR RefIdx) AND 0x01,
wherein XOR is an exclusive OR logical operation, and AND is a logical AND operation.
x=2{circumflex over (x)}+((LSB(y)XOR MVPindex) AND 0x01).
x=2{circumflex over (x)}+((LSB(y)XOR MVPindex XOR RefIdx XOR PartSize) AND 0x01).
x=2{circumflex over (x)}+LSB(y).
Sign(x)=(Magnitude(x)XOR Magnitude(y)XOR PartSize XOR RefIdx) AND 0x01,
wherein XOR is an exclusive OR logical operation, and AND is a logical AND operation.
x=2{circumflex over (x)}+((LSB(y)XOR MVPindex) AND 0x01).
x=2{circumflex over (x)}+((LSB(y)XOR MVPindex XOR RefIdx XOR PartSize) AND 0x01).
x=2{circumflex over (x)}+LSB(y).
Claims (4)
Sign(x)=(Magnitude(x)XOR Magnitude(y)XOR PartSize XOR RefIdx) AND 0x01,
Sign(x)=(Magnitude(x)XOR Magnitude(y)XOR PartSize XOR RefIdx) AND 0x01,
Sign(x)=(Magnitude(x)XOR Magnitude(y)XOR PartSize XOR RefIdx) AND 0x01,
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/097,344 US10911773B2 (en) | 2016-05-13 | 2017-05-12 | Motion vector difference coding and decoding |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201662335998P | 2016-05-13 | 2016-05-13 | |
US16/097,344 US10911773B2 (en) | 2016-05-13 | 2017-05-12 | Motion vector difference coding and decoding |
PCT/EP2017/061531 WO2017194773A1 (en) | 2016-05-13 | 2017-05-12 | Motion vector difference coding and decoding |
Publications (2)
Publication Number | Publication Date |
---|---|
US20190141346A1 US20190141346A1 (en) | 2019-05-09 |
US10911773B2 true US10911773B2 (en) | 2021-02-02 |
Family
ID=58701657
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US16/097,344 Active 2037-07-08 US10911773B2 (en) | 2016-05-13 | 2017-05-12 | Motion vector difference coding and decoding |
Country Status (2)
Country | Link |
---|---|
US (1) | US10911773B2 (en) |
WO (1) | WO2017194773A1 (en) |
Families Citing this family (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3806461A4 (en) | 2018-06-07 | 2022-03-16 | Wilus Institute of Standards and Technology Inc. | Video signal processing method and apparatus using adaptive motion vector resolution |
TWI723430B (en) * | 2018-06-19 | 2021-04-01 | 大陸商北京字節跳動網絡技術有限公司 | Multi-candidates of different precisions |
EP3827586A1 (en) | 2018-09-19 | 2021-06-02 | Beijing Bytedance Network Technology Co. Ltd. | Syntax reuse for affine mode with adaptive motion vector resolution |
US10841356B2 (en) * | 2018-11-28 | 2020-11-17 | Netflix, Inc. | Techniques for encoding a media title while constraining bitrate variations |
US10880354B2 (en) | 2018-11-28 | 2020-12-29 | Netflix, Inc. | Techniques for encoding a media title while constraining quality variations |
WO2020181476A1 (en) * | 2019-03-11 | 2020-09-17 | 华为技术有限公司 | Video image prediction method and device |
US11153598B2 (en) * | 2019-06-04 | 2021-10-19 | Tencent America LLC | Method and apparatus for video coding using a subblock-based affine motion model |
JP2023553922A (en) * | 2021-09-15 | 2023-12-26 | テンセント・アメリカ・エルエルシー | Method and apparatus for improved signaling of motion vector differences |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120189055A1 (en) | 2011-01-21 | 2012-07-26 | Qualcomm Incorporated | Motion vector prediction |
EP2618572A1 (en) | 2012-01-20 | 2013-07-24 | Research In Motion Limited | Multiple sign bit hiding within a transform unit |
EP2637409A1 (en) | 2012-03-08 | 2013-09-11 | BlackBerry Limited | Motion vector sign bit hiding |
-
2017
- 2017-05-12 WO PCT/EP2017/061531 patent/WO2017194773A1/en active Application Filing
- 2017-05-12 US US16/097,344 patent/US10911773B2/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120189055A1 (en) | 2011-01-21 | 2012-07-26 | Qualcomm Incorporated | Motion vector prediction |
EP2618572A1 (en) | 2012-01-20 | 2013-07-24 | Research In Motion Limited | Multiple sign bit hiding within a transform unit |
EP2637409A1 (en) | 2012-03-08 | 2013-09-11 | BlackBerry Limited | Motion vector sign bit hiding |
US20130235936A1 (en) * | 2012-03-08 | 2013-09-12 | Research In Motion Limited | Motion vector sign bit hiding |
Non-Patent Citations (2)
Title |
---|
Clare, G., "Sign Data Hiding", Joint Collaborative Team on Video Coding (JCT-VC) of ITU-T SG16 WP3 and ISO/IEC JTCI/SC29/WG11, 7th Meeting, Geneva, Document: JCTVS-G271, Nov. 21, 2011, pp. 1-9, ISO. |
Samuelsson, J., "Motion vector coding optimization", Joint Video Exploration Team (JVET), of ITU-T SG 16 WP 3 and ISO/IEC JTC 1/SC29/WG 11, 3rd Meeting, Geneva, Document JVET-C0068, May 26, 2016, pp. 1-3, ISO. |
Also Published As
Publication number | Publication date |
---|---|
WO2017194773A1 (en) | 2017-11-16 |
US20190141346A1 (en) | 2019-05-09 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10911773B2 (en) | Motion vector difference coding and decoding | |
US11140408B2 (en) | Affine motion prediction | |
US11503333B2 (en) | Unified merge candidate list usage | |
US10257536B2 (en) | Method of temporal derived bi-directional motion vector for motion vector prediciton | |
RU2697806C9 (en) | Moving picture decoding device and moving picture decoding method | |
JP2020109976A (en) | Image prediction method and device | |
US10567786B2 (en) | Motion vector processing | |
JP7297874B2 (en) | Apparatus and method for conditional decoder-side motion vector refinement in video coding | |
WO2013099285A1 (en) | Video encoding device, video encoding method and video encoding program, and video decoding device, video decoding method and video decoding program | |
KR20220064962A (en) | History-based motion vector prediction | |
CN111052739A (en) | Method and apparatus for image processing based on inter prediction mode | |
KR102600670B1 (en) | Motion vector prediction method and device, encoder, and decoder | |
JP2016042727A (en) | Moving picture coding device, moving picture coding method and moving picture coding program, and transmission device, transmission method and transmission program | |
CN113508599A (en) | Syntax for motion information signaling in video coding | |
JP2013153431A (en) | Video decoding device, video decoding method, and video decoding program | |
US10863189B2 (en) | Motion vector reconstruction order swap | |
WO2019191867A1 (en) | Method and apparatus for video encoding and decoding | |
JP2014131289A (en) | Moving image decoder and method | |
JP5725009B2 (en) | Moving picture decoding apparatus, moving picture decoding method, moving picture decoding program, receiving apparatus, receiving method, and receiving program | |
JP2022513492A (en) | How to derive a constructed affine merge candidate | |
RU2809673C2 (en) | Method and device for image prediction | |
CN111247804B (en) | Image processing method and device | |
JP5842803B2 (en) | Moving picture coding apparatus, moving picture coding method, moving picture coding program, transmission apparatus, transmission method, and transmission program | |
US20230095946A1 (en) | Block Vector Difference Signaling for Intra Block Copy | |
CN111355958B (en) | Video decoding method and device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: TELEFONAKTIEBOLAGET LM ERICSSON (PUBL), SWEDEN Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WENNERSTEN, PER;YU, RUOYANG;REEL/FRAME:047338/0487 Effective date: 20170515 |
|
FEPP | Fee payment procedure |
Free format text: ENTITY STATUS SET TO UNDISCOUNTED (ORIGINAL EVENT CODE: BIG.); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: PUBLICATIONS -- ISSUE FEE PAYMENT VERIFIED |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |