WO2016165617A1 - Method and apparatus for deriving temporal motion vector prediction - Google Patents
Method and apparatus for deriving temporal motion vector prediction Download PDFInfo
- Publication number
- WO2016165617A1 WO2016165617A1 PCT/CN2016/079141 CN2016079141W WO2016165617A1 WO 2016165617 A1 WO2016165617 A1 WO 2016165617A1 CN 2016079141 W CN2016079141 W CN 2016079141W WO 2016165617 A1 WO2016165617 A1 WO 2016165617A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- collocated
- motion vector
- picture
- tmvps
- tmvp
- Prior art date
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
- H04N19/51—Motion estimation or motion compensation
- H04N19/513—Processing of motion vectors
- H04N19/517—Processing of motion vectors by encoding
- H04N19/52—Processing of motion vectors by encoding by predictive encoding
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/30—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability
- H04N19/31—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using hierarchical techniques, e.g. scalability in the temporal domain
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/50—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding
- H04N19/503—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using predictive coding involving temporal prediction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
- H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
- H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
- H04N19/17—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
- H04N19/176—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
Definitions
- the present invention relates to video coding.
- the present invention relates to coding techniques associated with derivation of temporal motion vector candidate and motion vector prediction candidate.
- MVP Motion Vector Prediction
- AMVP Advanced Motion Vector Prediction
- HEVC High-Efficiency Video Coding
- a technique named Advanced Motion Vector Prediction (AMVP) is used to derive a motion vector predictor for a current motion vector.
- the AMVP technique uses explicit predictor signalling to indicate the MVP selected from a MVP candidate set.
- the MVP candidate set of AMVP includes spatial MVPs as well as a temporal MVP.
- the temporal MVP is derived based on motion vectors from a respective area (i.e., a collocated block) of a collocated picture.
- Fig. 1 illustrates an example of TMVP derivation, where the motion vector 112 from a collocated block 114 in a collocated picture 110 is used as a temporal MVP candidate.
- the MVP is used as one of the AMVP candidates for predicting the current motion vector 122 of the current block 124 in the current picture 120.
- the collocated picture is a reference picture of the current picture.
- the collocated block is a block corresponding to the current block. Usually it is the block at the same relative position in the collocated picture as the current block in the current picture.
- TMVP When TMVP is used to predict the current motion vector (MV) , it should be scaled based on the time distance between pictures.
- Fig. 2 illustrates an example of TMVP scaling, where the motion vector 212 from a collocated block 214 in a collocated picture 210 is scaled before it is used as one of the TMVP candidates for predicting the current motion vector 222 of the current block 224 in the current picture 220.
- the scaling can be based on time distance as measured by picture order count (POC) .
- POC picture order count
- the TMVP 212 points from the collocated picture to the reference picture 230.
- the current motion vector points from the current picture 220 to the reference picture 240.
- the TMVP has to be scaled before it is used as one of the AMVP candidates for predicting the current motion vector.
- the collocated picture is a fixed reference picture in the reference list.
- the encoder can choose any reference picture in the reference list as the collocated picture for the current picture.
- the information related to the reference picture selection is signalled from the encoder to the decoder in the slice header.
- a method and apparatus for encoding or decoding a motion vector (MV) of a current block of a current picture using motion vector prediction are disclosed. At least two collocated pictures are selected from a set of reference pictures of the current picture. One or more TMVPs are derived based on reference motion vectors (MVs) associated with collocated reference blocks of the collocated pictures. A motion vector prediction candidate set including one or more TMVPs is then determined. The current block is encoded or decoding using the motion vector prediction candidate set. The reference motion vectors (MVs) are scaled before the reference motion vectors (MVs) are used to derive the TMVPs.
- the total picture number corresponding to the collocated pictures can be fixed to a predetermined value. Alternatively, the total picture number corresponding to the collocated pictures can be determined by the encoder. The total picture number corresponding to the collocated pictures can be signalled from the encoder to the decoder in video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , slice header, coding unit (CU) , or prediction unit (PU) .
- the collocated pictures can be located at fixed positions in a reference picture list. Alternatively, the collocated pictures can be selected by the encoder and positions of the collocated pictures in a reference picture list can be signalled from the encoder to the decoder in VPS, SPS, PPS, slice header, CU, or PU.
- one reference motion vector associated with any of the collocated reference blocks for each collocated picture can be selected for deriving one or more TMVPs.
- the encoder may select the TMVP from any of the collocated reference blocks for each collocated picture and the encoder signals the selection information in a bitstream.
- N TMVPs can be selected from different collocated reference blocks in different collocated pictures.
- the N TMVPs can be inserted into the motion vector prediction candidate set corresponding to a merging candidate list or an advanced motion vector prediction (AMVP) candidate list, and N is a positive integer.
- the N TMVPs can be selected from different collocated reference blocks in different collocated pictures according to a selected checking order. When N is equal to one, the reference motion vectors of the collocated blocks in a first collocated picture are cheeked first. If any reference motion vectors associated with the collocated blocks is found, the reference motion vector is selected as the TMVP. Otherwise, the TMVP is selected from a next collocated picture.
- N is equal to two, if a first motion vector that is a firstly available reference motion vector associated with one checked collocated block of the first collocated picture in the selected checking order is found, the first motion vector is selected as the first TMVP and checking remaining collocated blocks of the first collocated picture is skipped. The collocated blocks of a second collocated picture are then checked in the selected checking order. If a second motion vector that is a firstly available reference motion vector associated with one checked collocated block of the second collocated picture in the selected checking order is found, the second motion vector is selected as the second TMVP and checking remaining collocated blocks of the second collocated picture is skipped.
- the reference motion vectors (MVs) associated with the collocated reference blocks of the collocated pictures are allowed to be stored in a spatial compressed format, and different collocated pictures may use different compression ratios.
- the encoder may transmit one or more syntax elements to specify whether the reference motion vectors (MVs) are stored in the spatial compressed format.
- the syntax elements may be signalled in a VPS, SPS, PPS, or slice header.
- a first TMVP and a second TMVP can be combined to form a third TMVP with a third motion vector, and the third motion vector is derived by averaging a first motion vector obtained by scaling the first TMVP and a second motion vector obtained by scaling the second TMVP.
- N TMVPs can be combined to form a new TMVP with a new motion vector, and the new motion vector is derived by averaging N motion vectors obtained by scaling the N TMVPs respectively.
- the reference motion vectors (MVs) associated with the collocated reference blocks of the collocated pictures can be scaled to a fixed time-distance before the reference motion vectors (MVs) are stored in a buffer. In this case, the reference picture indices for the reference motion vectors (MVs) do not need to be stored.
- a number of remaining candidates of the motion vector prediction candidate set is determined. If the number of remaining candidates is less than or equal to a threshold, only one TMVP is included in the motion vector prediction candidate set, otherwise two or more TMVPs are included in the motion vector prediction candidate set.
- Fig. 1 illustrates an example of TMVP derivation, where the motion vector is fetched from a collocated block in a collocated picture.
- Fig. 2 illustrates an example of TMVP scaling, where the motion vector from a collocated block in a collocated picture is scaled before it is used as one of the AMVP candidates for predicting the current motion vector of the current block in the current picture.
- Fig. 3 illustrates an example of advanced temporal motion vector prediction according to the present invention, where N collocated pictures are used to derive the TMVP and N ⁇ 2.
- Fig. 4 illustrates exemplary collocated blocks, which can be within the ‘original collocated block’ or spatial neighbouring blocks of the ‘original collocated block’ .
- Fig. 5 illustrates two exemplary checking orders for N TMVPs in two different collocated pictures.
- Fig. 6 illustrates an exemplary process of scaling all motion vectors in a collocated picture to a fixed time distance.
- Fig. 7 illustrates an exemplary flowchart for a video coding system incorporating advanced temporal motion vector prediction (ATMVP) according an embodiment of the present invention.
- ATMVP advanced temporal motion vector prediction
- FIG. 3 illustrates an example of advanced temporal motion vector prediction according to the present invention, where N collocated pictures are used to derive the TMVP and N ⁇ 2.
- the motion vector 312-1 from a collocated block 314-1 in a collocated picture 310-1, the motion vector 312-2 from a collocated block 314-2 in a collocated picture 310-2, through motion vector 312-N from a collocated block 314-N in a collocated picture 310-N are used to derive the TMVP as one of the AMVP candidates for predicting the current motion vector 322 of the current block 324 in the current picture 320.
- the number of collocated pictures can be a predetermined number, such as 2, 3, 4, etc.
- the number of collocated pictures can be determined by the encoder and signalled from the encoder to the decoder. It can be signalled in video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , slice header, coding unit (CU) , or prediction unit (PU) .
- VPS video parameter set
- SPS sequence parameter set
- PPS picture parameter set
- CU coding unit
- PU prediction unit
- the collocated pictures can be placed at fixed positions in the reference picture list.
- the collocated pictures can be chosen by the encoder and their positions in the reference picture list can be signalled from the encoder to the decoder. It can be signalled in video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , slice header, coding unit (CU) , or prediction unit (PU) .
- VPS video parameter set
- SPS sequence parameter set
- PPS picture parameter set
- CU coding unit
- PU prediction unit
- a new syntax element col_pic_num is signalled as shown in Note (1-1) to specify the number of collocated reference pictures used.
- the reference list col_pic_list [col_pic_idx] and reference picture index col_pic_refidx [col_pic_idx] are signalled as indicated by Notes (1-2) and (1-3) .
- Fig. 4 illustrates exemplary collocated blocks from B1 through B36, which can be within the “original collocated block” 410 or spatial neighbouring blocks of the “original collocated block” .
- the original collocated block represents the block at the same relative position in the collocated picture as the current block in the current picture.
- the encoder can choose the TMVP from any collocated block in any collocated picture. Furthermore, the information of TMVP related to the corresponding collocated block and the collocated picture can be signalled from the encoder to the decoder. The information can be signalled in slice header, coding unit (CU) , or prediction unit (PU) .
- CU coding unit
- PU prediction unit
- N TMVPs from different collocated blocks in different collocated pictures can be inserted into the merging candidate list as N merging candidates.
- N TMVPs from different collocated blocks in different collocated pictures can be inserted into the advanced motion vector prediction (AMVP) candidate list as N AMVP candidates.
- AMVP advanced motion vector prediction
- the N TMVPs can be fetched by checking different collocated blocks in different collocated pictures in any checking order. When enough TMVPs are derived, the checking process may be terminated.
- Fig. 5 illustrates two exemplary checking orders for N TMVPs in two different collocated pictures, where the N TMVPs are selected from the K collocated blocks (i.e., B 1 , B 1 , ... , B K ) in two collocated pictures (i.e., ColPic 1 and ColPic 2) .
- First checking order 510 checks all collocated blocks in collocated picture ColPic 1 and then checks all collocated blocks in collocated picture ColPic 2.
- Second checking order 520 checks first collocated block in all collocated pictures and then moves to the next collocated block in all collocated pictures. According to checking order 520, for the collocated block at each location, the checking order is from the first picture to the last picture.
- N can be set to 1 and in this case, at most one TMVP can be used in the merging candidate list or AMVP candidate list.
- Collocated blocks in a first collocated picture can be checked first. If motion vectors can be found in collocated blocks in the first collocated picture, one or more of them will be used to derive the TMVP . Otherwise, collocated blocks in a second collocated picture will be checked.
- N can be set to 2 and in this case, at most 2 TMVPs are included in the merging candidate list or AMVP candidate list.
- Collocated blocks in a first collocated picture can be checked first in order. If one motion vector can be found in a collocated block in the first collocated picture, it will be chosen as the first TMVP. Checking for other collocated blocks in the first collocated picture will be skipped. Then, collocated blocks in a second collocated picture should be checked in order. If one motion vector can be found in a collocated block in the second collocated picture, it will be chosen as the second TMVP.
- a number of remaining candidates of the motion vector prediction candidate set is determined. If the number of remaining candidates is less than or equal to a threshold, only one TMVP is included in the motion vector prediction candidate set, otherwise two or more TMVPs are included in the motion vector prediction candidate set.
- the number of TMVPs to be included in the motion vector prediction candidate set depends on the size of the motion vector prediction candidate set and the number of motion vector prediction candidates already included in the motion vector prediction candidate set.
- the motion vectors can be compressed for different collocated pictures with different compression ratio.
- motion vectors in collocated picture 1 can be compressed by 16 to 1 and motion vectors in collocated picture 2 can be compressed by 4 to 1.
- Motion vector compression for reducing required storage space has been used in video coding standards such as HEVC, where the motion vectors associated with blocks are stored at spatially reduced resolution.
- the motion vectors for every two horizontal blocks and every two vertical blocks can be stored to achieve 4 to 1 compression.
- a 16 to 1 compression can be achieved.
- the encoder can signal the information regarding whether to compress MVs and the compression ratio for each collocated picture to the decoder.
- the information can be signalled in VPS, SPS, PPS, or slice header.
- Such motion vector compression technique results in compressed form for motion vectors, which is referred as the spatial compressed format in this disclosure.
- TMVPs from different collocated blocks in one or more collocated pictures can be combined to form a new TMVP.
- TMVP1 equal to MV1
- TMVP2 equal to MV2
- TMVP3 can be obtained by scaling MV1
- MV4 can be obtained by scaling MV2.
- TMVP1 equal to MV1 and TMVP2 equal to MV2 can be combined as a new TMVP candidate TMVP 3 with MV3, where MV3 is equal to (MV4+MV5) /2, MV4 can be obtained by scaling MV1 and MV5 can be obtained by scaling MV2.
- TMVP1 equal to MV1
- TMVP2 equal to MV2, ...
- TMVPN equal to MVN
- MV_new (MV1’ +MV2’ + ... +MVN’ ) /N
- MV1’ , MV2’ , ... , MVN’ can be obtained by scaling MV1, MV2, ... MVN respectively.
- MVs in a collocated picture can be scaled to a fixed time-distance before they are stored to the buffer.
- TMVP time-distance
- Fig. 6 illustrates an exemplary process of scaling all motion vectors in a collocated picture to a fixed time distance.
- the three MVs (612, 614 and 616) of the collocated picture 610 point to three different reference pictures (620, 630 and 640) .
- the MVs are scaled to point to the reference picture with time-distance equal to 1 (i.e., the reference picture 620) .
- the scaled MVs (652, 654 and 656) are stored without the need to store the reference picture indices.
- Fig. 7 illustrates an exemplary flowchart for a video coding system incorporating advanced temporal motion vector prediction (ATMVP) according an embodiment of the present invention.
- the system selects at least two collocated pictures from a set of reference pictures of the current picture in step 710.
- One or more TMVPs are derived based on reference motion vectors (MVs) associated with collocated reference blocks of said at least two collocated pictures in step 720.
- MVs reference motion vectors
- a motion vector prediction candidate set including said one or more TMVPs is determined in step 730.
- the motion vector prediction candidate set is then used to encode or decode the current block in step 740.
- Embodiment of the present invention as described above may be implemented in various hardware, software codes, or a combination of both.
- an embodiment of the present invention can be one or more electronic circuits integrated into a video compression chip or program code integrated into video compression software to perform the processing described herein.
- An embodiment of the present invention may also be program code to be executed on a Digital Signal Processor (DSP) to perform the processing described herein.
- DSP Digital Signal Processor
- the invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) .
- These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention.
- the software code or firmware code may be developed in different programming languages and different formats or styles.
- the software code may also be compiled for different target platforms.
- different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Compression Or Coding Systems Of Tv Signals (AREA)
Abstract
A method and apparatus for encoding or decoding a motion vector (MV) of a current block of a current picture using advanced temporal motion vector prediction are disclosed. At least two collocated pictures are selected from a set of reference pictures of the current picture. One or more TMVPs are derived based on reference motion vectors (MVs) associated with collocated reference blocks of the collocated pictures. A motion vector prediction candidate set including one or more TMVPs is then determined. The current block is encoded or decoding using the motion vector prediction candidate set. The reference motion vectors (MVs) are scaled before the reference motion vectors (MVs) are used to derive the TMVPs.
Description
CROSS REFERENCE TO RELATED APPLICATIONS
The present invention claims priority to PCT Patent Application, Serial No. PCT/CN2015/076542, filed on April 14, 2015. The PCT Patent Application is hereby incorporated by reference in its entirety.
The present invention relates to video coding. In particular, the present invention relates to coding techniques associated with derivation of temporal motion vector candidate and motion vector prediction candidate.
BACKGROUND AND RELATED ARTS
In video coding systems, spatial and temporal redundancy is exploited using spatial and temporal prediction to reduce the information to be transmitted. The spatial and temporal prediction utilizes decoded pixels from the same picture and reference pictures respectively to form prediction for current pixels to be coded. In a conventional coding system, side information associated with spatial and temporal prediction may have to be transmitted, which will take up some bandwidth of the compressed video data. The transmission of motion vectors for temporal prediction may require a noticeable portion of the compressed video data. To further reduce the bitrate associated with motion vectors, a technique called Motion Vector Prediction (MVP) has been used in the field of video coding. The MVP technique exploits the statistic redundancy among neighbouring motion vectors spatially and temporally. In the rest of this document, MVP may sometimes denote “motion vector prediction” and sometimes
denote “motion vector predictor” according to contexts.
In High-Efficiency Video Coding (HEVC) development, a technique named Advanced Motion Vector Prediction (AMVP) is used to derive a motion vector predictor for a current motion vector. The AMVP technique uses explicit predictor signalling to indicate the MVP selected from a MVP candidate set. In HEVC, the MVP candidate set of AMVP includes spatial MVPs as well as a temporal MVP. The temporal MVP is derived based on motion vectors from a respective area (i.e., a collocated block) of a collocated picture. Fig. 1 illustrates an example of TMVP derivation, where the motion vector 112 from a collocated block 114 in a collocated picture 110 is used as a temporal MVP candidate. The MVP is used as one of the AMVP candidates for predicting the current motion vector 122 of the current block 124 in the current picture 120. The collocated picture is a reference picture of the current picture. The collocated block is a block corresponding to the current block. Usually it is the block at the same relative position in the collocated picture as the current block in the current picture.
When TMVP is used to predict the current motion vector (MV) , it should be scaled based on the time distance between pictures. Fig. 2 illustrates an example of TMVP scaling, where the motion vector 212 from a collocated block 214 in a collocated picture 210 is scaled before it is used as one of the TMVP candidates for predicting the current motion vector 222 of the current block 224 in the current picture 220. The scaling can be based on time distance as measured by picture order count (POC) . In Fig. 2, the TMVP 212 points from the collocated picture to the reference picture 230. On the other hand, the current motion vector points from the current picture 220 to the reference picture 240. The TMVP has to be scaled before it is used as one of the AMVP candidates for predicting the current motion vector.
There is also a Merge mode used in various advanced video coding, where the motion vector information of a current block can share the motion information of a previously coded block. In this case, information regarding the merging candidate needs to be identified. However, there is no need to transmit the motion information for the current block.
Accordingly, the Merge mode can achieve a higher degree of coding efficiency. The merging candidates can be derived in a similar fashion as the AMVP candidate.
In H. 264/AVC, the collocated picture is a fixed reference picture in the reference list. In H. 265/HEVC, the encoder can choose any reference picture in the reference list as the collocated picture for the current picture. The information related to the reference picture selection is signalled from the encoder to the decoder in the slice header.
It is desirable to explore techniques to improve the efficiency of temporal motion vector prediction.
BRIEF SUMMARY OF THE INVENTION
A method and apparatus for encoding or decoding a motion vector (MV) of a current block of a current picture using motion vector prediction are disclosed. At least two collocated pictures are selected from a set of reference pictures of the current picture. One or more TMVPs are derived based on reference motion vectors (MVs) associated with collocated reference blocks of the collocated pictures. A motion vector prediction candidate set including one or more TMVPs is then determined. The current block is encoded or decoding using the motion vector prediction candidate set. The reference motion vectors (MVs) are scaled before the reference motion vectors (MVs) are used to derive the TMVPs.
The total picture number corresponding to the collocated pictures can be fixed to a predetermined value. Alternatively, the total picture number corresponding to the collocated pictures can be determined by the encoder. The total picture number corresponding to the collocated pictures can be signalled from the encoder to the decoder in video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , slice header, coding unit (CU) , or prediction unit (PU) . The collocated pictures can be located at fixed positions in a reference picture list. Alternatively, the collocated pictures can be selected by the encoder and positions of the collocated pictures in a reference picture list can be signalled from the encoder
to the decoder in VPS, SPS, PPS, slice header, CU, or PU.
In one embodiment, one reference motion vector associated with any of the collocated reference blocks for each collocated picture can be selected for deriving one or more TMVPs. The encoder may select the TMVP from any of the collocated reference blocks for each collocated picture and the encoder signals the selection information in a bitstream.
In another embodiment, N TMVPs can be selected from different collocated reference blocks in different collocated pictures. The N TMVPs can be inserted into the motion vector prediction candidate set corresponding to a merging candidate list or an advanced motion vector prediction (AMVP) candidate list, and N is a positive integer. The N TMVPs can be selected from different collocated reference blocks in different collocated pictures according to a selected checking order. When N is equal to one, the reference motion vectors of the collocated blocks in a first collocated picture are cheeked first. If any reference motion vectors associated with the collocated blocks is found, the reference motion vector is selected as the TMVP. Otherwise, the TMVP is selected from a next collocated picture. When N is equal to two, if a first motion vector that is a firstly available reference motion vector associated with one checked collocated block of the first collocated picture in the selected checking order is found, the first motion vector is selected as the first TMVP and checking remaining collocated blocks of the first collocated picture is skipped. The collocated blocks of a second collocated picture are then checked in the selected checking order. If a second motion vector that is a firstly available reference motion vector associated with one checked collocated block of the second collocated picture in the selected checking order is found, the second motion vector is selected as the second TMVP and checking remaining collocated blocks of the second collocated picture is skipped.
In yet another embodiment, the reference motion vectors (MVs) associated with the collocated reference blocks of the collocated pictures are allowed to be stored in a spatial compressed format, and different collocated pictures may use different compression ratios. The
encoder may transmit one or more syntax elements to specify whether the reference motion vectors (MVs) are stored in the spatial compressed format. The syntax elements may be signalled in a VPS, SPS, PPS, or slice header.
In yet another embodiment, a first TMVP and a second TMVP can be combined to form a third TMVP with a third motion vector, and the third motion vector is derived by averaging a first motion vector obtained by scaling the first TMVP and a second motion vector obtained by scaling the second TMVP. Also, N TMVPs can be combined to form a new TMVP with a new motion vector, and the new motion vector is derived by averaging N motion vectors obtained by scaling the N TMVPs respectively. The reference motion vectors (MVs) associated with the collocated reference blocks of the collocated pictures can be scaled to a fixed time-distance before the reference motion vectors (MVs) are stored in a buffer. In this case, the reference picture indices for the reference motion vectors (MVs) do not need to be stored.
In yet another embodiment, a number of remaining candidates of the motion vector prediction candidate set is determined. If the number of remaining candidates is less than or equal to a threshold, only one TMVP is included in the motion vector prediction candidate set, otherwise two or more TMVPs are included in the motion vector prediction candidate set.
Fig. 1 illustrates an example of TMVP derivation, where the motion vector is fetched from a collocated block in a collocated picture.
Fig. 2 illustrates an example of TMVP scaling, where the motion vector from a collocated block in a collocated picture is scaled before it is used as one of the AMVP candidates for predicting the current motion vector of the current block in the current picture.
Fig. 3 illustrates an example of advanced temporal motion vector prediction according to the present invention, where N collocated pictures are used to derive the TMVP
and N ≥ 2.
Fig. 4 illustrates exemplary collocated blocks, which can be within the ‘original collocated block’ or spatial neighbouring blocks of the ‘original collocated block’ .
Fig. 5 illustrates two exemplary checking orders for N TMVPs in two different collocated pictures.
Fig. 6 illustrates an exemplary process of scaling all motion vectors in a collocated picture to a fixed time distance.
Fig. 7 illustrates an exemplary flowchart for a video coding system incorporating advanced temporal motion vector prediction (ATMVP) according an embodiment of the present invention.
The following description is of the best-contemplated mode of carrying out the invention. This description is made for the purpose of illustrating the general principles of the invention and should not be taken in a limiting sense. The scope of the invention is best determined by reference to the appended claims.
An advanced temporal motion vector prediction (ATMVP) method is disclosed to improve the coding efficiency. Fig. 3 illustrates an example of advanced temporal motion vector prediction according to the present invention, where N collocated pictures are used to derive the TMVP and N ≥ 2. The motion vector 312-1 from a collocated block 314-1 in a collocated picture 310-1, the motion vector 312-2 from a collocated block 314-2 in a collocated picture 310-2, through motion vector 312-N from a collocated block 314-N in a collocated picture 310-N are used to derive the TMVP as one of the AMVP candidates for predicting the current motion vector 322 of the current block 324 in the current picture 320.
In one embodiment, the number of collocated pictures can be a predetermined number, such as 2, 3, 4, etc.
In another embodiment, the number of collocated pictures can be determined by the encoder and signalled from the encoder to the decoder. It can be signalled in video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , slice header, coding unit (CU) , or prediction unit (PU) .
In one embodiment, the collocated pictures can be placed at fixed positions in the reference picture list.
In another embodiment, the collocated pictures can be chosen by the encoder and their positions in the reference picture list can be signalled from the encoder to the decoder. It can be signalled in video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , slice header, coding unit (CU) , or prediction unit (PU) .
An exemplary syntax table for signalling the collocated pictures is shown below.
Table 1
As shown in the above table, a new syntax element col_pic_num is signalled as shown in Note (1-1) to specify the number of collocated reference pictures used. For each collocated reference picture, the reference list col_pic_list [col_pic_idx] and reference picture index col_pic_refidx [col_pic_idx] are signalled as indicated by Notes (1-2) and (1-3) .
One or more collocated blocks in each collocated picture can be used to derive the TMVP and the TMVP can be fetched from any of those collocated blocks. Fig. 4 illustrates exemplary collocated blocks from B1 through B36, which can be within the “original collocated block” 410 or spatial neighbouring blocks of the “original collocated block” . The original collocated block represents the block at the same relative position in the collocated picture as the current block in the current picture.
The encoder can choose the TMVP from any collocated block in any collocated picture. Furthermore, the information of TMVP related to the corresponding collocated block and the collocated picture can be signalled from the encoder to the decoder. The information can be signalled in slice header, coding unit (CU) , or prediction unit (PU) .
In one embodiment, N TMVPs from different collocated blocks in different collocated pictures can be inserted into the merging candidate list as N merging candidates.
In one embodiment, N TMVPs from different collocated blocks in different collocated pictures can be inserted into the advanced motion vector prediction (AMVP) candidate list as N AMVP candidates.
The N TMVPs can be fetched by checking different collocated blocks in different collocated pictures in any checking order. When enough TMVPs are derived, the checking process may be terminated. Fig. 5 illustrates two exemplary checking orders for N TMVPs in two different collocated pictures, where the N TMVPs are selected from the K collocated blocks (i.e., B1, B1, … , BK) in two collocated pictures (i.e., ColPic 1 and ColPic 2) . First checking order 510 checks all collocated blocks in collocated picture ColPic 1 and then checks all collocated blocks in collocated picture ColPic 2. Second checking order 520 checks first collocated block in all collocated pictures and then moves to the next collocated block in all collocated pictures. According to checking order 520, for the collocated block at each location, the checking order is from the first picture to the last picture.
For example, N can be set to 1 and in this case, at most one TMVP can be used in the merging candidate list or AMVP candidate list. Collocated blocks in a first collocated picture can be checked first. If motion vectors can be found in collocated blocks in the first collocated picture, one or more of them will be used to derive the TMVP . Otherwise, collocated blocks in a second collocated picture will be checked.
In another example, N can be set to 2 and in this case, at most 2 TMVPs are included in the merging candidate list or AMVP candidate list. Collocated blocks in a first collocated picture can be checked first in order. If one motion vector can be found in a collocated block in the first collocated picture, it will be chosen as the first TMVP. Checking for other collocated blocks in the first collocated picture will be skipped. Then, collocated blocks in a second collocated picture should be checked in order. If one motion vector can be found in a collocated block in the second collocated picture, it will be chosen as the second TMVP.
In one embodiment, a number of remaining candidates of the motion vector prediction candidate set is determined. If the number of remaining candidates is less than or equal to a threshold, only one TMVP is included in the motion vector prediction candidate set, otherwise two or more TMVPs are included in the motion vector prediction candidate set. The number of TMVPs to be included in the motion vector prediction candidate set depends on the size of the motion vector prediction candidate set and the number of motion vector prediction candidates already included in the motion vector prediction candidate set.
The motion vectors can be compressed for different collocated pictures with different compression ratio. For example, motion vectors in collocated picture 1 can be compressed by 16 to 1 and motion vectors in collocated picture 2 can be compressed by 4 to 1. Motion vector compression for reducing required storage space has been used in video coding standards such as HEVC, where the motion vectors associated with blocks are stored at spatially reduced resolution. For example, the motion vectors for every two horizontal blocks and every two vertical blocks can be stored to achieve 4 to 1 compression. In the case that he
motion vectors are stored for every four horizontal blocks and every four vertical blocks, a 16 to 1 compression can be achieved. The encoder can signal the information regarding whether to compress MVs and the compression ratio for each collocated picture to the decoder. The information can be signalled in VPS, SPS, PPS, or slice header. Such motion vector compression technique results in compressed form for motion vectors, which is referred as the spatial compressed format in this disclosure.
Different TMVPs from different collocated blocks in one or more collocated pictures can be combined to form a new TMVP.
Two motion vectors from two different collocated pictures can be combined and used as a new bi-prediction TMVP. For example, TMVP1 equal to MV1 and TMVP2 equal to MV2 can be combined as a new TMVP candidate TMVP 3, which utilizes bi-prediction. For TMVP3 with MV3 referring to a reference picture in reference list 0 and MV4 referring to a reference picture in reference list 1, MV3 can be obtained by scaling MV1 and MV4 can be obtained by scaling MV2.
In another example, TMVP1 equal to MV1 and TMVP2 equal to MV2 can be combined as a new TMVP candidate TMVP 3 with MV3, where MV3 is equal to (MV4+MV5) /2, MV4 can be obtained by scaling MV1 and MV5 can be obtained by scaling MV2.
In one example, TMVP1 equal to MV1, TMVP2 equal to MV2, … , and TMVPN equal to MVN can be combined as a new TMVP candidate TMVP_new with MV_new, where MV_new = (MV1’ +MV2’ + … +MVN’ ) /N, where MV1’ , MV2’ , … , MVN’ can be obtained by scaling MV1, MV2, … MVN respectively.
In one embodiment, MVs in a collocated picture can be scaled to a fixed time-distance before they are stored to the buffer. For example, MVs can all be scaled to a reference picture with time-distance=1. When the MVs are fetched from collocated pictures as
TMVP, they can be scaled as if they refer to a reference picture with time-distance=1. Fig. 6 illustrates an exemplary process of scaling all motion vectors in a collocated picture to a fixed time distance. In Fig. 6, the three MVs (612, 614 and 616) of the collocated picture 610 point to three different reference pictures (620, 630 and 640) . The MVs are scaled to point to the reference picture with time-distance equal to 1 (i.e., the reference picture 620) . The scaled MVs (652, 654 and 656) are stored without the need to store the reference picture indices.
Fig. 7 illustrates an exemplary flowchart for a video coding system incorporating advanced temporal motion vector prediction (ATMVP) according an embodiment of the present invention. The system selects at least two collocated pictures from a set of reference pictures of the current picture in step 710. One or more TMVPs are derived based on reference motion vectors (MVs) associated with collocated reference blocks of said at least two collocated pictures in step 720. A motion vector prediction candidate set including said one or more TMVPs is determined in step 730. The motion vector prediction candidate set is then used to encode or decode the current block in step 740.
The above description is presented to enable a person of ordinary skill in the art to practice the present invention as provided in the context of a particular application and its requirement. Various modifications to the described embodiments will be apparent to those with skill in the art, and the general principles defined herein may be applied to other embodiments. Therefore, the present invention is not intended to be limited to the particular embodiments shown and described, but is to be accorded the widest scope consistent with the principles and novel features herein disclosed. In the above detailed description, various specific details are illustrated in order to provide a thorough understanding of the present invention. Nevertheless, it will be understood by those skilled in the art that the present invention may be practiced.
Embodiment of the present invention as described above may be implemented in various hardware, software codes, or a combination of both. For example, an embodiment of
the present invention can be one or more electronic circuits integrated into a video compression chip or program code integrated into video compression software to perform the processing described herein. An embodiment of the present invention may also be program code to be executed on a Digital Signal Processor (DSP) to perform the processing described herein. The invention may also involve a number of functions to be performed by a computer processor, a digital signal processor, a microprocessor, or field programmable gate array (FPGA) . These processors can be configured to perform particular tasks according to the invention, by executing machine-readable software code or firmware code that defines the particular methods embodied by the invention. The software code or firmware code may be developed in different programming languages and different formats or styles. The software code may also be compiled for different target platforms. However, different code formats, styles and languages of software codes and other means of configuring code to perform the tasks in accordance with the invention will not depart from the spirit and scope of the invention.
The invention may be embodied in other specific forms without departing from its spirit or essential characteristics. The described examples are to be considered in all respects only as illustrative and not restrictive. The scope of the invention is therefore, indicated by the appended claims rather than by the foregoing description. All changes which come within the meaning and range of equivalency of the claims are to be embraced within their scope.
Claims (23)
- A method of encoding or decoding a motion vector (MV) of a current block of a current picture using motion vector prediction, comprising:selecting at least two collocated pictures from a set of reference pictures of the current picture;deriving one or more temporal motion vector predictors (TMVPs) based on reference motion vectors (MVs) associated with collocated reference blocks of said at least two collocated pictures;determining a motion vector prediction candidate set including said one or more TMVPs; andencoding or decoding the current block using the motion vector prediction candidate set.
- The method of Claim 1, wherein said reference motion vectors (MVs) are scaled before said reference motion vectors (MVs) are used to derive said one or more TMVPs.
- The method of Claim 1, wherein a total picture number corresponding to said at least two collocated pictures is fixed to a predetermined value.
- The method of Claim 1, wherein a total picture number corresponding to said at least two collocated pictures is determined by an encoder.
- The method of Claim 4, wherein the total picture number corresponding to said at least two collocated pictures is signalled from the encoder to a decoder in video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , slice header, coding unit (CU) , or prediction unit (PU) .
- The method of Claim 1, wherein said at least two collocated pictures are located at fixed positions in a reference picture list.
- The method of Claim 1, wherein said at least two collocated pictures are selected by an encoder and positions of said at least two collocated pictures in a reference picture list are signalled from the encoder to a decoder.
- The method of Claim 7, wherein the positions of said at least two collocated pictures in a reference picture list are signalled from the encoder to a decoder in video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , slice header, coding unit (CU) , or prediction unit (PU) .
- The method of Claim 1, wherein one reference motion vector associated with a collocated reference block for each collocated picture is selected for said deriving said one or more TMVPs.
- The method of Claim 9, wherein an encoder selects one TMVP associated with the selected reference motion vector and the encoder signals selection information in a bitstream.
- The method of Claim 1, wherein said deriving one or more TMVPs selects N TMVPs from different collocated reference blocks in different collocated pictures and said N TMVPs are inserted into the motion vector prediction candidate set corresponding to a merging candidate list or an advanced motion vector prediction (AMVP) candidate list, and wherein N is a positive integer.
- The method of Claim 11, wherein said deriving one or more TMVPs selects said N TMVPs from different collocated reference blocks in different collocated pictures according to a selected checking order.
- The method of Claim 11, wherein when N is equal to one, said deriving one or more TMVPs checks one or more collocated blocks in a first collocated picture first; if any reference motion vector associated with said one or more collocated blocks is found, said deriving one or more TMVPs selects the reference motion vector found as one TMVP; and otherwise said deriving one or more TMVPs selects one TMVP from a next collocated picture.
- The method of Claim 11, wherein when N is equal to two, said deriving one or more TMVPs checks one or more collocated blocks of a first collocated picture in a selected checking order; if a first motion vector that is a firstly available reference motion vector associated with one checked collocated block of the first collocated picture in the selected checking order is found, the first motion vector is selected as a first TMVP and checking remaining collocated blocks of the first collocated picture is skipped; said deriving one or more TMVPs then checks one or more collocated blocks of a second collocated picture in the selected checking order; and if a second motion vector that is a firstly available reference motion vector associated with one checked collocated block of the second collocated picture in the selected checking order is found, the second motion vector is selected as a second TMVP and checking remaining collocated blocks of the second collocated picture is skipped.
- The method of Claim 1, wherein said reference motion vectors (MVs) associated with the collocated reference blocks of said at least two collocated pictures are allowed to be stored in a spatial compressed format, and different collocated pictures are allowed to use different compression ratios.
- The method of Claim 15, wherein an encoder transmits one or more syntax elements to specify whether said reference motion vectors (MVs) associated with the collocated reference blocks of said at least two collocated pictures are stored in the spatial compressed format and said one or more syntax elements are signalled in a video parameter set (VPS) , sequence parameter set (SPS) , picture parameter set (PPS) , or slice header.
- The method of Claim 1, wherein a first TMVP and a second TMVP are combined to form a bi-prediction TMVP with a first motion vector in a first reference list and a second motion vector in a second reference list, and wherein the first motion vector is obtained by scaling the first TMVP and the second motion vector is obtained by scaling the second TMVP.
- The method of Claim 1, wherein a first TMVP and a second TMVP are combined to form a third TMVP with a third motion vector, and wherein the third motion vector is derived by averaging a first motion vector obtained by scaling the first TMVP and a second motion vector obtained by scaling the second TMVP.
- The method of Claim 1, wherein N TMVPs are combined to form a new TMVP with a new motion vector, and wherein the new motion vector is derived by averaging N motion vectors obtained by scaling the N TMVPs respectively and wherein N is a positive integer. .
- The method of Claim 1, wherein the reference motion vectors (MVs) associated with the collocated reference blocks of said at least two collocated pictures are scaled to a fixed time-distance before the reference motion vectors (MVs) are stored in a buffer.
- The method of Claim 20, wherein reference picture indices for the reference motion vectors (MVs) are not stored.
- The method of Claim 1, further comprising determining a number of remaining candidates of the motion vector prediction candidate set, if the number of remaining candidates is less than or equal to a threshold, only one TMVP is included in the motion vector prediction candidate set, otherwise two or more TMVPs are included in the motion vector prediction candidate set.
- An apparatus for encoding or decoding a motion vector (MV) of a current block of a current picture using motion vector prediction, comprising one or more electronic circuits arranged to:select at least two collocated pictures from a set of reference pictures of the current picture;derive one or more TMVPs based on reference motion vectors (MVs) associated with collocated reference blocks of said at least two collocated pictures;determine a motion vector prediction candidate set including said one or more TMVPs; andencode or decode the current block using the motion vector prediction candidate set.
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201680021290.5A CN107534778A (en) | 2015-04-14 | 2016-04-13 | Obtain the method and device of motion vector prediction |
US15/564,206 US10412406B2 (en) | 2015-04-14 | 2016-04-13 | Method and apparatus for deriving temporal motion vector prediction |
EP16779592.1A EP3266211A4 (en) | 2015-04-14 | 2016-04-13 | Method and apparatus for deriving temporal motion vector prediction |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
PCT/CN2015/076542 WO2016165069A1 (en) | 2015-04-14 | 2015-04-14 | Advanced temporal motion vector prediction in video coding |
CNPCT/CN2015/076542 | 2015-04-14 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2016165617A1 true WO2016165617A1 (en) | 2016-10-20 |
Family
ID=57125514
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/076542 WO2016165069A1 (en) | 2015-04-14 | 2015-04-14 | Advanced temporal motion vector prediction in video coding |
PCT/CN2016/079141 WO2016165617A1 (en) | 2015-04-14 | 2016-04-13 | Method and apparatus for deriving temporal motion vector prediction |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2015/076542 WO2016165069A1 (en) | 2015-04-14 | 2015-04-14 | Advanced temporal motion vector prediction in video coding |
Country Status (4)
Country | Link |
---|---|
US (1) | US10412406B2 (en) |
EP (1) | EP3266211A4 (en) |
CN (1) | CN107534778A (en) |
WO (2) | WO2016165069A1 (en) |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018128223A1 (en) * | 2017-01-03 | 2018-07-12 | 엘지전자 주식회사 | Inter-prediction method and apparatus in image coding system |
WO2019194514A1 (en) * | 2018-04-01 | 2019-10-10 | 엘지전자 주식회사 | Image processing method based on inter prediction mode, and device therefor |
US11228780B2 (en) | 2018-03-26 | 2022-01-18 | Huawei Technologies Co., Ltd. | Inter prediction apparatus and method for video coding |
Families Citing this family (34)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP3655918B1 (en) | 2017-09-05 | 2021-11-03 | Huawei Technologies Co., Ltd. | Fast block matching method for collaborative filtering in lossy video codecs |
BR112020018716A2 (en) * | 2018-03-19 | 2020-12-29 | Qualcomm Incorporated | IMPROVEMENTS IN ADVANCED TEMPORAL MOTION VECTOR PREDICTION |
WO2019194502A1 (en) * | 2018-04-01 | 2019-10-10 | 엘지전자 주식회사 | Inter prediction mode based image processing method and apparatus therefor |
WO2019191890A1 (en) | 2018-04-02 | 2019-10-10 | 深圳市大疆创新科技有限公司 | Image processing method and image processing device |
WO2019234609A1 (en) | 2018-06-05 | 2019-12-12 | Beijing Bytedance Network Technology Co., Ltd. | Interaction between ibc and bio |
US11025904B2 (en) * | 2018-06-08 | 2021-06-01 | Tencent America LLC | Method and apparatus for temporal motion vector prediction |
CN110636300B (en) | 2018-06-21 | 2022-07-29 | 北京字节跳动网络技术有限公司 | Sub-block motion vector inheritance between color components |
TWI739120B (en) | 2018-06-21 | 2021-09-11 | 大陸商北京字節跳動網絡技術有限公司 | Unified constrains for the merge affine mode and the non-merge affine mode |
CN117812257A (en) | 2018-07-02 | 2024-04-02 | Lg电子株式会社 | Image decoding method, image encoding method, storage medium, and transmission method |
CN112544077B (en) * | 2018-07-16 | 2023-12-08 | Lg电子株式会社 | Inter prediction method for temporal motion information prediction in sub-block unit and apparatus therefor |
WO2020016859A2 (en) * | 2018-07-20 | 2020-01-23 | Beijing Bytedance Network Technology Co., Ltd. | Motion prediction based on updated motion vectors |
KR20210115053A (en) * | 2018-07-27 | 2021-09-24 | 삼성전자주식회사 | Image decoding apparatus and method based on sub block, and image encoding apparatus and method based on sub block |
MX2021002201A (en) * | 2018-08-29 | 2021-05-14 | Beijing Dajia Internet Information Tech Co Ltd | Methods and apparatus of video coding using subblock-based temporal motion vector prediction. |
CN110944193B (en) | 2018-09-24 | 2023-08-11 | 北京字节跳动网络技术有限公司 | Weighted bi-prediction in video encoding and decoding |
CN110650348A (en) * | 2018-10-03 | 2020-01-03 | 北京达佳互联信息技术有限公司 | Method for deriving motion vector, method for encoding motion vector, apparatus, device, and medium |
US11457234B2 (en) | 2018-10-08 | 2022-09-27 | Lg Electronics Inc. | Apparatus for performing image coding on basis of ATMVP candidate |
WO2020084552A1 (en) | 2018-10-24 | 2020-04-30 | Beijing Bytedance Network Technology Co., Ltd. | Motion candidate derivation based on spatial neighboring block in sub-block motion vector prediction |
JP7324841B2 (en) | 2018-11-10 | 2023-08-10 | 北京字節跳動網絡技術有限公司 | Video data processing method, apparatus, storage medium and storage method |
CN113056920B (en) * | 2018-11-22 | 2024-05-24 | 北京字节跳动网络技术有限公司 | Coordination method of inter prediction based on subblocks |
CN113170174B (en) | 2018-11-30 | 2024-04-12 | 寰发股份有限公司 | Video processing method and apparatus for determining motion vectors for storage in video coding system |
WO2020125756A1 (en) | 2018-12-21 | 2020-06-25 | Beijing Bytedance Network Technology Co., Ltd. | Motion vector bit depth in video processing |
WO2020135482A1 (en) * | 2018-12-29 | 2020-07-02 | Beijing Bytedance Network Technology Co., Ltd. | Construction method for default motion candidate in sub-block based inter prediction |
CN113498609B (en) * | 2018-12-31 | 2023-06-20 | 北京达佳互联信息技术有限公司 | Picture resolution dependent configuration for video codec |
CN113261294B (en) * | 2019-01-02 | 2024-06-18 | Lg电子株式会社 | Inter prediction method and device based on SBTMVP |
CN111953997A (en) * | 2019-05-15 | 2020-11-17 | 华为技术有限公司 | Candidate motion vector list obtaining method and device and coder-decoder |
WO2020252422A1 (en) * | 2019-06-13 | 2020-12-17 | Beijing Dajia Internet Information Technology Co., Ltd. | Motion vector prediction for video coding |
US11601666B2 (en) * | 2019-06-25 | 2023-03-07 | Qualcomm Incorporated | Derivation of temporal motion vector prediction candidates in video coding |
CN110213590B (en) * | 2019-06-25 | 2022-07-12 | 浙江大华技术股份有限公司 | Method and equipment for acquiring time domain motion vector, inter-frame prediction and video coding |
JP7481430B2 (en) | 2019-08-13 | 2024-05-10 | 北京字節跳動網絡技術有限公司 | Motion Accuracy in Subblock-Based Inter Prediction |
CN110740317B (en) * | 2019-09-18 | 2021-10-15 | 浙江大华技术股份有限公司 | Subblock motion prediction method, subblock motion encoding method, subblock motion encoder, and storage device |
WO2021052506A1 (en) | 2019-09-22 | 2021-03-25 | Beijing Bytedance Network Technology Co., Ltd. | Transform unit based combined inter intra prediction |
CN113382249B (en) * | 2021-04-21 | 2022-09-06 | 浙江大华技术股份有限公司 | Image/video encoding method, apparatus, system, and computer-readable storage medium |
WO2023109899A1 (en) * | 2021-12-15 | 2023-06-22 | FG Innovation Company Limited | Device and method for coding video data |
CN115802039B (en) * | 2023-02-10 | 2023-06-23 | 天翼云科技有限公司 | Inter-frame coding method, inter-frame coding device, electronic equipment and computer readable medium |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012171442A1 (en) * | 2011-06-15 | 2012-12-20 | Mediatek Inc. | Method and apparatus of motion and disparity vector prediction and compensation for 3d video coding |
WO2013109975A1 (en) * | 2012-01-20 | 2013-07-25 | Qualcomm Incorporated | Temporal motion vector predictor candidate |
US20140064374A1 (en) * | 2012-08-29 | 2014-03-06 | Vid Scale, Inc. | Method and apparatus of motion vector prediction for scalable video coding |
WO2014106346A1 (en) * | 2013-01-07 | 2014-07-10 | Mediatek Singapore Pte. Ltd. | Method of signalling additional collocated picture for 3dvc |
Family Cites Families (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101621694B (en) * | 2009-07-29 | 2012-01-11 | 深圳市九洲电器有限公司 | Motion estimation method, motion estimation system and display terminal |
US9124898B2 (en) * | 2010-07-12 | 2015-09-01 | Mediatek Inc. | Method and apparatus of temporal motion vector prediction |
US20120013441A1 (en) * | 2010-07-16 | 2012-01-19 | Wal-Mart Stores, Inc. | Method and Apparatus Pertaining to Facilitating the Reading of RFID Tags |
US8555430B2 (en) * | 2010-07-28 | 2013-10-15 | Edgar L. Nicas | In-shower foot scrubber |
US9137544B2 (en) * | 2010-11-29 | 2015-09-15 | Mediatek Inc. | Method and apparatus for derivation of mv/mvp candidate for inter/skip/merge modes |
US8711940B2 (en) * | 2010-11-29 | 2014-04-29 | Mediatek Inc. | Method and apparatus of motion vector prediction with extended motion vector predictor |
WO2012108701A2 (en) * | 2011-02-09 | 2012-08-16 | 엘지전자 주식회사 | Method for storing motion information and method for inducing temporal motion vector predictor using same |
EP3139611A1 (en) * | 2011-03-14 | 2017-03-08 | HFI Innovation Inc. | Method and apparatus for deriving temporal motion vector prediction |
WO2012133372A1 (en) * | 2011-03-31 | 2012-10-04 | テルモ株式会社 | Artificial lung |
EP2769544A4 (en) * | 2011-10-21 | 2015-12-23 | Nokia Technologies Oy | Method for video coding and an apparatus |
KR101607038B1 (en) * | 2011-11-21 | 2016-04-11 | 모토로라 모빌리티 엘엘씨 | Implicit determination and combined implicit and explicit determination of collocated picture for temporal prediction |
EP2824920A4 (en) * | 2012-03-06 | 2016-02-17 | Panasonic Ip Corp America | Method for coding video, method for decoding video, device for coding video, device for decoding video, and device for coding/decoding video |
EP2680173A3 (en) * | 2012-06-29 | 2014-01-15 | Orange | Determining implicit social networking relationships and organization |
US9491461B2 (en) * | 2012-09-27 | 2016-11-08 | Qualcomm Incorporated | Scalable extensions to HEVC and temporal motion vector prediction |
CN103079067B (en) * | 2013-01-09 | 2016-03-09 | 华为技术有限公司 | Motion vector predictor list builder method and video coding-decoding method and device |
US9609347B2 (en) * | 2013-04-04 | 2017-03-28 | Qualcomm Incorporated | Advanced merge mode for three-dimensional (3D) video coding |
US9667996B2 (en) * | 2013-09-26 | 2017-05-30 | Qualcomm Incorporated | Sub-prediction unit (PU) based temporal motion vector prediction in HEVC and sub-PU design in 3D-HEVC |
US10271064B2 (en) * | 2015-06-11 | 2019-04-23 | Qualcomm Incorporated | Sub-prediction unit motion vector prediction using spatial and/or temporal motion information |
-
2015
- 2015-04-14 WO PCT/CN2015/076542 patent/WO2016165069A1/en active Application Filing
-
2016
- 2016-04-13 US US15/564,206 patent/US10412406B2/en active Active
- 2016-04-13 CN CN201680021290.5A patent/CN107534778A/en active Pending
- 2016-04-13 EP EP16779592.1A patent/EP3266211A4/en not_active Withdrawn
- 2016-04-13 WO PCT/CN2016/079141 patent/WO2016165617A1/en active Application Filing
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2012171442A1 (en) * | 2011-06-15 | 2012-12-20 | Mediatek Inc. | Method and apparatus of motion and disparity vector prediction and compensation for 3d video coding |
WO2013109975A1 (en) * | 2012-01-20 | 2013-07-25 | Qualcomm Incorporated | Temporal motion vector predictor candidate |
US20140064374A1 (en) * | 2012-08-29 | 2014-03-06 | Vid Scale, Inc. | Method and apparatus of motion vector prediction for scalable video coding |
WO2014106346A1 (en) * | 2013-01-07 | 2014-07-10 | Mediatek Singapore Pte. Ltd. | Method of signalling additional collocated picture for 3dvc |
Non-Patent Citations (1)
Title |
---|
See also references of EP3266211A4 * |
Cited By (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2018128223A1 (en) * | 2017-01-03 | 2018-07-12 | 엘지전자 주식회사 | Inter-prediction method and apparatus in image coding system |
US11394976B2 (en) | 2017-01-03 | 2022-07-19 | Lg Electronics Inc. | Inter-prediction method and apparatus in image coding system |
US11800114B2 (en) | 2017-01-03 | 2023-10-24 | Lg Electronics Inc. | Inter-prediction method and apparatus in image coding system |
US11228780B2 (en) | 2018-03-26 | 2022-01-18 | Huawei Technologies Co., Ltd. | Inter prediction apparatus and method for video coding |
WO2019194514A1 (en) * | 2018-04-01 | 2019-10-10 | 엘지전자 주식회사 | Image processing method based on inter prediction mode, and device therefor |
US11252432B2 (en) | 2018-04-01 | 2022-02-15 | Lg Electronics Inc. | Image processing method based on inter prediction mode, and device therefor |
US11632565B2 (en) | 2018-04-01 | 2023-04-18 | Lg Electronics Inc. | Image processing method based on inter prediction mode, and device therefor |
US11949904B2 (en) | 2018-04-01 | 2024-04-02 | Lg Electronics Inc. | Image processing method based on inter prediction mode, and device therefor |
Also Published As
Publication number | Publication date |
---|---|
EP3266211A4 (en) | 2018-08-01 |
WO2016165069A1 (en) | 2016-10-20 |
EP3266211A1 (en) | 2018-01-10 |
US10412406B2 (en) | 2019-09-10 |
US20180255316A1 (en) | 2018-09-06 |
CN107534778A (en) | 2018-01-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10412406B2 (en) | Method and apparatus for deriving temporal motion vector prediction | |
US11856218B2 (en) | Motion candidate derivation based on spatial neighboring block in sub-block motion vector prediction | |
US10257536B2 (en) | Method of temporal derived bi-directional motion vector for motion vector prediciton | |
TWI690194B (en) | Sub-prediction unit temporal motion vector prediction (sub-pu tmvp) for video coding | |
US20200077088A1 (en) | Method and apparatus of decoder side motion derivation for video coding | |
US10412407B2 (en) | Method and apparatus of inter prediction using average motion vector for video coding | |
US9900596B2 (en) | Moving picture coding device, moving picture coding method and moving picture coding program, and moving picture decoding device, moving picture decoding method and moving picture decoding program | |
US9596483B2 (en) | Method and apparatus of improved intra luma prediction mode coding | |
US20190028731A1 (en) | Method and apparatus for affine inter prediction for video coding system | |
US9307239B2 (en) | Method and apparatus for derivation of motion vector candidate and motion vector prediction candidate | |
RU2768377C1 (en) | Method and device for video coding using improved mode of merging with motion vector difference | |
KR20220000917A (en) | Motion vector refinement for multi-reference prediction | |
TWI719522B (en) | Symmetric bi-prediction mode for video coding | |
US11539977B2 (en) | Method and apparatus of merge with motion vector difference for video coding | |
RU2795830C2 (en) | Method and device for video encoding using improved merge mode with motion vector difference |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 16779592 Country of ref document: EP Kind code of ref document: A1 |
|
WWE | Wipo information: entry into national phase |
Ref document number: 15564206 Country of ref document: US |
|
REEP | Request for entry into the european phase |
Ref document number: 2016779592 Country of ref document: EP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |