JP2021192510A - Video coding method, video coding device, computer readable storage medium, and computer programming product - Google Patents

Abstract

To provide a composite inter and intra-prediction (CIIP) method for video coding.SOLUTION: A video coding method includes obtaining first and second reference images associated with the current prediction block, generating first prediction L0 on the basis of a first motion vector MV0 from the current prediction block to a reference block in a first reference image, generating second prediction L1 on the basis of a second motion vector MV1 from the current prediction block to a reference block in a second reference image, identifying whether bidirectional optical flow (BDOF) operation applies, and calculating the double prediction for the current prediction block on the basis of the first prediction L0 and the second prediction L1, and first and second gradient values.SELECTED DRAWING: Figure 3

Description

The present application claims priority based on provisional application No. 62 / 790,421 filed on January 9, 2019, the entire contents of which are incorporated herein by reference.

This application relates to video coding and compression. More specifically, the present application relates to methods and devices relating to composite inter and intra-prediction (CIIP) methods for video coding.

Various video coding techniques can be used to compress the video data. Video coding is performed according to one or more video coding standards. For example, video coding standards include Versatile Video Coding (VVC), Joint Exploration Test Model (JEM), High Efficiency Video Coding (H.265 / HEVC), Advanced Video Coding (H.264 / AVC), Video Experts. Group (MPEG)
Coding etc. are included. Video coding is generally a predictive method that takes advantage of the redundancy present in a video image or sequence (eg, inter-prediction, intra-prediction, etc.).
To use. An important goal of video coding technology is to compress video data into a format that uses a lower bit rate while avoiding or minimizing video quality degradation.

The examples in the present disclosure provide methods for improving the efficiency of syntactic signaling in merge-related modes.

According to a second aspect of the present disclosure, it is based on obtaining a reference image in the reference image list associated with the current prediction block and a first motion vector from the current image to the first reference image. , To generate an inter-prediction, to acquire an intra-prediction mode associated with the current forecast block, to generate an intra-prediction of the current forecast block based on the intra-prediction, and to generate the inter-prediction. And by averaging the intra predictions to generate the final prediction of the current prediction block, and the current prediction block intersperses with the most likely mode (MPM) based intramode predictions. A method of video coding that compromises between identifying whether it is treated as mode or intra mode.

According to a fourth aspect of the present disclosure, a non-temporary computer-readable storage medium for storing instructions is provided. When run by one or more processors, it gets the reference image in the reference image list associated with the current prediction block and is based on the first motion vector from the current image to the first reference image. To generate an inter-prediction, to acquire an intra-prediction mode associated with the current forecast block, and to generate an intra-prediction of the current forecast block based on the intra-prediction.
By averaging the inter-prediction and the intra-prediction, the final prediction of the current prediction block is generated, and the current prediction block is the most probable mode (MP).
M) Have the computing device perform actions, including specifying whether the base intramode prediction is treated as intermode or intramode.

It should be understood that both the general description above and the detailed description below are merely examples and are not intended to limit this disclosure.

The accompanying drawings incorporated and in part thereof herein provide examples consistent with the present disclosure and, along with explanations, serve to explain the principles of the present disclosure.
It is a block diagram of an encoder according to an example of this disclosure. It is a block diagram of a decoder according to an example of this disclosure. It is a flowchart which shows the method for generating a compound inter and an intra prediction (CIIP) by an example of this disclosure. It is a flowchart which shows the method for generating CIIP by one example of this disclosure. It is a figure which shows the block partition in the multi-type tree structure by an example of this disclosure. It is a figure which shows the block partition in the multi-type tree structure by an example of this disclosure. It is a figure which shows the block partition in the multi-type tree structure by an example of this disclosure. It is a figure which shows the block partition in the multi-type tree structure by an example of this disclosure. It is a figure which shows the block partition in the multi-type tree structure by an example of this disclosure. It is a figure which shows the composite inter and the intra prediction (CIIP) by an example of this disclosure. It is a figure which shows the composite inter and the intra prediction (CIIP) by an example of this disclosure. It is a figure which shows the composite inter and the intra prediction (CIIP) by an example of this disclosure. It is a flowchart of the MPM candidate list generation process by an example of this disclosure. It is a flowchart of the MPM candidate list generation process by an example of this disclosure. It is a figure which shows the workflow of the existing CIIP design in VVC by an example of this disclosure. It is a figure which shows the workflow of the proposed CIIP method by removing BDOF by one example of this disclosure. FIG. 6 illustrates a single prediction-based CIIP workflow that selects a prediction list based on POC distance, according to an example of the present disclosure. It is a flowchart of the method when the CIIP block is enabled for MPM candidate list generation by an example of this disclosure. It is a flowchart of the method when the CIIP block is invalidated for MPM candidate list generation by an example of this disclosure. It is a figure which shows the computing environment combined with the user interface by an example of this disclosure.

Here, an example of the present disclosure is referred to in detail and an example is shown in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers represent the same or similar elements in different drawings, unless otherwise stated. The embodiments described in the following description of the examples of the present disclosure do not represent all embodiments consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with the aspects of the present disclosure described in the appended claims.

The terminology used in this disclosure is intended solely to describe a particular embodiment.
It is not intended to limit this disclosure. As used in this disclosure and the appended claims, the singular forms "a,""an," and "the" are intended to include the plural unless explicitly stated in the context. ing. It should also be understood that the term "and / or" as used herein means and is intended to include any or all possible combinations of one or more of the related listed items.

Here, various information can be described using terms such as "first", "second", "third", but it is understood that the information should not be limited by these terms. I want to be. These terms are used only to distinguish information in one category from another. For example, without departing from the scope of the present disclosure, the first information may be referred to as the second information, and similarly, the second information may be referred to as the first information. As used herein, the term "if" means "when" or "at the time" or "if", depending on the context.
It can be understood to mean "according to judgment".

The first version of the HEVC standard was completed in October 2013, which is the previous generation video coding standard H.D. It offers about 50% bitrate savings or equivalent perceptual quality compared to 264 / MPEG AVC. Although the HEVC standard offers significant coding improvements over its predecessor, there is evidence that adding coding tools to HEVC can achieve superior coding efficiency. Based on this, VCEG and MPE
Both G have begun exploring new coding technologies for future video coding standardization. ITU-TVECG and ISO / IE in October 2015 to begin critical research on advanced technologies that can significantly improve coding efficiency.
One Joint Video Exploration Team (JVET) was formed by C MPEG. One reference software, called the Joint Exploration Model (JEM), integrates several additional coding tools on top of the HEVC Test Model (HM) to JVE.
It was maintained by T.

In October 2017, the Joint Proposal Call for Video Compression (CfP) with features beyond HEVC was published by ITU-T and ISO / IEC. In April 2018, at the 10th JVET meeting, 23 CfP responses were received and evaluated, about 40% more than HEVC.
The compression efficiency gain of was demonstrated. Based on such evaluation results, JVET is Versatil.
He has launched a new project to develop a new generation of video coding standards called e Video Coding (VVC). In the same month, a reference software code base called the VVC Test Model (VTM) was established to demonstrate the reference implementation of the VVC standard.

Like HEVC, VVC is built on a block-based hybrid video coding framework. FIG. 1 (described below) gives a block diagram of a typical block-based hybrid video coding system. The input video signal is processed block by block (called a coding unit (CU)). In VTM-1.0, C
U can be up to 128x128 pixels. However, unlike HEVC, which divides blocks based solely on the quad tree, VVC has one coding tree unit (CTU) CU to adapt to various local characteristics based on the quad / dual / turnary tree. It is divided into. In addition, the concept of multiple partition unit types in HEVC has been removed, that is, the separation of CUs and predictive units (PUs) and conversion units (TUs) no longer exists in VVCs, instead each CU always has additional partitions. Used as the basic unit for both prediction and transformation without. In a multi-type tree structure, one CTU is first separated by a quad tree structure. Each quadtree leaf node can then be further subdivided in a binary and turnary tree structure.
As shown in FIGS. 5A, 5B, 5C, 5D, 5D, and 5E (described below), quaternary partitioning, horizontal binary partitioning, vertical binary partitioning, and horizontal, respectively. There are five division types: ternary partitioning and vertical ternary partitioning.

In FIG. 1 (described below), spatial and / or temporal predictions can be performed.
Spatial prediction (or "intra prediction") uses pixels from a sample of already coded adjacent blocks (called a reference sample) in the same video image / slice to predict the current video block. Spatial prediction reduces the spatial redundancy inherent in video signals. Time prediction (also called "inter-prediction" or "motion compensation prediction".
) Predicts the current video block using the reconstructed pixels from the already coded video image. Time prediction reduces the time redundancy inherent in video signals. The time prediction signal for a particular CU is usually signaled by one or more motion vectors (MVs) indicating the amount and direction of motion between the current CU and its time reference. Further, when a plurality of reference images are supported, one reference image index is additionally transmitted. It is used to identify from which reference image the time prediction signal comes from in the reference image store. After spatial and / or time prediction, the mode determination block in the encoder selects the optimal prediction mode, for example, based on a rate distortion optimization method. The predictive block is then subtracted from the current video block and the predictive residuals are uncorrelated using transformation and quantization.

The quantized residual coefficients are inversely transformed with the inverse quantization to form the reconstructed residuals, which are then added to the prediction block to form the reconstructed signal of the CU. Further in-loop filtering, such as deblocking filters, sample adaptive offsets (SAOs), and adaptive in-loop filters (ALFs), were reconfigured before being placed in the reference image store and used to code future video blocks. Can be applied to. To form the output video bitstream, the coding mode (inter or intra), predictive mode information, motion information, and quantized residual coefficients are all sent to the entropy coding unit and further compressed and packed into bits. Form a stream.

FIG. 2 (described below) shows a typical block diagram of a block-based video decoder. The video bitstream is first entropy-decoded by the entropy-decoding unit. Coding modes and prediction information are transmitted to either the spatial prediction unit (if intracoded) or the time prediction unit (if intercoded) to form a prediction block. The residual transformation factor is transmitted to the inverse quantization unit and the inverse transformation unit to reconstruct the residual block. Next, the prediction block and the residual block are added together. The reconstructed block can go through further in-loop filtering before being stored in the reference image store. The reconstructed video in the reference image store is then sent out to drive the display device and is also used to predict future video blocks.

FIG. 1 shows a typical encoder 100. The encoder 100 has a video input 110,
Motion compensation 112, motion estimation 114, intra / intermode determination 116, block predictor 140, adder 128, conversion 130, quantization 132, prediction related information 142, intra prediction 118, image buffer 120, dequantization 134, reverse It has a conversion 136, an adder 126, a memory 124, an in-loop filter 122, an entropy coding 138, and a bitstream 144.

FIG. 2 shows a block diagram of a typical decoder 200. The decoder 200 includes a bitstream 210, an entropy decode 212, an inverse quantization 214, an inverse transformation 216, and an adder 2.
It has 18, intra / intermode selection 220, intra prediction 222, memory 230, in-loop filter 228, motion compensation 224, image buffer 226, prediction related information 234, and video output 232.

FIG. 3 shows an exemplary method 300 for generating compound inter and intra-prediction (CIIP) according to the present disclosure.

In step 310, the first reference image and the second associated with the current prediction block.
Get the reference image of. Here, the first reference image is in front of the current image in display order and is second.
The reference image of is after the current image in display order.

In step 312, the first prediction L0 is acquired based on the first motion vector MV0 from the current prediction block to the reference block in the first reference image.

In step 314, a second prediction L1 is acquired based on the second motion vector MV1 from the current prediction block to the reference block in the second reference image.

FIG. 4 shows an exemplary method for generating CIIP according to the present disclosure. For example, the method includes single prediction-based inter-prediction and MPM-based intra-prediction to generate CIIP.

In step 410, the reference image in the reference image list associated with the current prediction block is acquired.

In step 412, an inter-prediction is generated based on the first motion vector from the current image to the first reference image.

In step 414, the intra prediction mode associated with the current prediction block is acquired.

In step 416, an intra prediction for the current prediction block is generated based on the intra prediction.

In step 418, the final prediction of the current prediction block is generated by averaging the inter-forecast and the intra-forecast.

In step 420, the current prediction block is the most likely mode (MPM).
Identify whether the base intramode prediction is treated as intermode or intramode.

FIG. 5A shows a diagram showing a block quaternary partition in a multitype tree structure according to an example of the present disclosure.

FIG. 5B shows a block vertical binary partition in a multitype tree structure according to an example of the present disclosure.

FIG. 5C shows a block horizontal binary partition in a multitype tree structure according to an example of the present disclosure.

FIG. 5D shows a block vertical ternary partition in a multitype tree structure according to an example of the present disclosure.

FIG. 5E shows a block horizontal ternary partition in a multitype tree structure according to an example of the present disclosure.

Composite Inter and Intra Prediction As shown in FIGS. 1 and 2, the inter and intra prediction method is used in a hybrid video coding scheme. Here, each PU is allowed to choose between inter-prediction or intra-prediction to take advantage of correlation, either in the time domain or in the spatial domain, not both. However, as pointed out in the conventional literature, the residual signals generated by the inter-prediction block and the intra-prediction block may exhibit very different characteristics from each other. Therefore, if the two types of predictions can be efficiently combined, another accurate prediction can be expected in order to reduce the energy of the prediction residuals and improve the coding efficiency. In addition, natural video content can complicate the movement of moving objects. For example, there may be areas that contain both old content (for example, objects contained in previously coded images) and new new content (for example, objects excluded in previously coded images). .. In such a scenario, neither inter-prediction nor intra-prediction can provide an accurate prediction for one of the current blocks.

To further improve predictive efficiency, the VVC standard employs compound inter and intra-prediction (CIIP), which combines intra-prediction and inter-prediction of one CU coded by merge mode. Specifically, for each merge CU, one additional flag is signaled to indicate whether CIIP is enabled for the current CU. For luminance components, CIIP supports four frequently used intramodes, including planar mode, DC mode, horizontal mode, and vertical mode. For the saturation component, DM (ie, saturation reuses the same intramode of the luminance component) is always applied without any additional signaling. In addition, the existing CI
In IP design, a weighted average is applied and one CIIP CU inter-prediction sample and intra-prediction sample are combined. Specifically, when planar mode or DC mode is selected, equal weights (ie, 0.5) are applied. Otherwise (that is, either horizontal or vertical mode applies), the current CU is initially horizontal (in horizontal mode) or vertical (in vertical mode) four areas of the same size. It is divided into.

In addition, in the current VVC operating specification, the intramode of one CIIP CU is used as a predictor to predict the intramode of its adjacent CIIP CU via the most likely mode (MPM) mechanism. Can be done. Specifically, each CI
For IP CUs, where the adjacent blocks are also CIIP CUs, the intramodes of those adjacent blocks are initially planar mode, DC mode, horizontal mode, and so on.
And rounded to the nearest mode in vertical mode, then added to the current CU's MPM candidate list. However, when constructing the MPM list for each intra-CU, one of its adjacent blocks is considered unusable if it is coded in CIIP mode. That is, the intramode of one CIIP CU is not allowed to predict the intramode of its adjacent intra-CU. 7A and 7B (discussed below) compare the MPM list generation processes of the intra-CU and CIIP CU.

Here, shift and o _offset are 15-BD and 1 << (14-BD) + 2 · (1 << 13 respectively).
), Which is the right shift value and offset value applied to combine the L0 and L1 prediction signals of the double prediction.

FIG. 6A shows a diagram showing a horizontal mode composite inter and intra prediction according to an example of the present disclosure.

FIG. 6B shows a diagram showing a composite inter and intra prediction in vertical mode according to an example of the present disclosure.

FIG. 6C shows a diagram showing a composite inter and intra prediction of planar mode and DC mode according to an example of the present disclosure.

FIG. 7A shows a flowchart of the MPM candidate list generation process of the intra-CUS according to an example of the present disclosure.

FIG. 7B shows a flowchart of the MPM candidate list generation process of CIIP CU according to an example of the present disclosure.

Improvements to CIIP CIIP can increase the efficiency of conventional motion compensation prediction, but can further improve its design. Specifically, the following issues in the existing CIIP design in VVC are identified in this disclosure.

First, as explained in the section "Composite Inter and Intra Prediction", CIIP
In order to combine the inter and intra prediction samples, each CIIP CU needs to generate a prediction signal using its reconstructed adjacent sample. This is one CII
It means that the decoding of PCU depends on the complete reconstruction of its adjacent blocks. Due to these interdependencies, in a real hardware implementation, CIIP needs to be performed during the reconfiguration phase when adjacent reconstructed samples are available for intra-prediction. Since the CU decoding at the reconstruction stage must be performed sequentially (ie, one at a time), the number of computational operations (eg, multiplication, addition, bit shift) included in the CIIP process is real-time decoding. It cannot be too high to ensure sufficient throughput.

As mentioned in the "Bidirectional Optical Flow" section, BDOF has predictive quality when one intercoded CU is predicted from two reference blocks from both anterior and posterior temporal directions. Enabled to improve. As shown in FIG. 8 (described below), in current VVCs, BDOF is also involved in producing inter-prediction samples in CIIP mode. Given the further complexity of BDOF, such a design would be a hardware codec encoding / if CIIP is enabled.
Decoding throughput can be significantly reduced.

Next, in the current CIIP design, when one CIIP CU refers to one double-predicted merge candidate, it is necessary to generate both motion compensation prediction signals of lists L0 and L1. If one or more MVs are not integer precision, an additional interpolation process must be called to interpolate the sample at the partial sample position.
Not only does such a process add computational complexity, but it also increases memory bandwidth if more reference samples need to be accessed from external memory.

Then, as discussed in the section "Composite Inter and Intra Prediction", the current CI
In IP design, the intra-mode of the CIIP CU and the intra-mode of the intra-CU are treated differently when constructing the MPM list of their adjacent blocks. Specifically, if one current CU is coded in CIIP mode, the adjacent CIIP CU is considered intra, that is, the intra mode of the adjacent CIIP CU is added to the MPM candidate list. Can be However, if the current CU is coded in intramode, the adjacent CIIP CU is considered inter, that is, the intramode of the adjacent CIIP CU is excluded from the MPM candidate list. Such a non-uniform design may not be optimal for the final version of the VVC standard.

FIG. 8 shows a diagram showing an existing CIIP design workflow in VVC according to an example of the present disclosure.

Simplification of CIIP This disclosure provides a method for simplifying an existing CIIP design to facilitate hardware codec implementation. In general, the main aspects of the technique proposed in this disclosure are summarized as follows.

First, it is proposed to exclude BDOF from the generation of interpredicted samples in CIIP mode in order to improve CIIP coding / decoding throughput.

Second, to reduce computational complexity and memory bandwidth consumption, one CIIP
When the CU is double-predicted (ie, has both L0 and L1 MV), a method of converting the block from double-predicted to single-predicted is proposed to generate an inter-predicted sample.

Then, two methods are proposed to reconcile the intramodes of the intra-CU and CIIP when forming MPM candidates for adjacent blocks.

CIIP without BDOF
As pointed out in the "Problem Statement" section, BDOF is the current C.
When U is double-predicted, it is always enabled to generate an inter-prediction sample for CIIP mode. Due to the additional complexity of BDOF, existing CIIP designs can significantly reduce encoding / decoding throughput, especially real-time decoding can be difficult for VVC decoders. On the other hand, CIIP
For CU, the final predicted sample is generated by averaging the inter-predicted sample and the intra-predicted sample. In other words, the improved prediction sample by BDOF is not used directly as the prediction signal of CIIP CU. Therefore, the corresponding improvements obtained from BDOF are less efficient in CIIP CU as compared to traditional double predictive CUs, where BDOF is applied directly to generate predictive samples. Therefore, based on the above circumstances, it is proposed to disable BDOF when generating an inter-prediction sample in CIIP mode. FIG. 9 (described below) shows the corresponding workflow of the proposed CIIP process after removing BDOF.

FIG. 9 shows a diagram showing the workflow of the proposed CIIP method by removing BDOF according to an example of the present disclosure.

CIIP based on a single forecast
As mentioned above, when the merge candidates referenced by one CIIP CU are double predicted, both L0 and L1 prediction signals are generated to predict the samples in the CU. In order to reduce memory bandwidth and interpolation complexity, in one embodiment of the present disclosure, (current CU).
Only the inter-prediction sample generated using the single prediction (even if is double-predicted) will be used to combine with the intra-prediction sample in CIIP mode. Specifically, when the current CIIP CU is a single forecast, the inter-prediction sample is
Directly combined with the intra-prediction sample. Otherwise (ie, if the current CU is double-predicted), the inter-prediction sample used by CIIP is generated based on a single forecast from one forecast list (L0 or L1). To. Various methods can be applied to select the forecast list. In the first method, it is proposed to always select the first prediction (ie, list L0) for any CIIP block predicted by the two reference images.

In the second method, it is proposed to always select the second prediction (ie, list L1) for any CIIP block predicted by the two reference images. In a third method, one adaptation method is applied when a prediction list associated with one reference image with a small image order count (POC) distance from the current image is selected. FIG. 10 (described below) shows a single prediction-based CIIP workflow that selects a prediction list based on POC distance.

Finally, the last method proposes to enable CIIP mode only if the current CU is single predicted. In addition, to reduce overhead, CII
The signaling of the enable / disable flag of P depends on the prediction direction of the current CIIP CU. In the case of a single prediction of the current CU, the CIIP flag is signaled in a bitstream to indicate whether CIIP is enabled or disabled. Otherwise (ie, if the current CU is doubly predicted), the signaling of the CIIP flag is skipped and always presumed to be false, that is, CIIP is always disabled.

FIG. 10 shows a diagram showing a single prediction-based CIIP workflow that selects a prediction list based on POC distances, according to an example of the present disclosure.

Harmonization of Intra CU and CIIP Intra Modes for MPM Candidate List Configuration As mentioned above, the current CIIP design uses the Intra CU and CIIP CU Intra modes to form an MPM candidate list for their adjacent blocks. There is no unification in terms of method. Specifically, in both the intra mode of the intra CU and the intra mode of the CIIP CU, the intra mode of the adjacent block coded in the CIIP mode can be predicted.
However, the intra mode of the intra CU can be predicted only by the intra mode of the intra CU. To achieve another unified design, two methods are proposed in this section, harmonizing the use of intra-CU and CIIP intramodes for MPM list construction.

In the first method, it is proposed to treat the CIIP mode as an intermode for MPM list configuration. Specifically, one CIIP CU or one intra CU
When generating an MPM list for any of the above, if the adjacent block is coded in CIIP mode, the intramode of the adjacent block is marked as unavailable.
In such a method, the MPM list cannot be constructed using the intramode of the CIIP block. On the contrary, in the second method, it is proposed to treat the CIIP mode as an intra mode for MPM list configuration. Specifically, in this method, CII
In the PCU intramode, both the adjacent CIIP block and intrablock intramodes can be predicted. 11A and 11B (described below) show the MPM candidate list generation process when the above two methods are applied.

Other embodiments of the present disclosure will be apparent to those of skill in the art by considering the specifications and practices of the present disclosure disclosed herein. The present application is in accordance with its general principles, any modification, use, of the present disclosure, including deviations from the present disclosure, which are known or within the bounds of conventional practice in the art.
Or intended to cover conformance. The true scope and spirit of the present disclosure is set forth by the claims below, and the specification and examples are intended to be viewed solely as examples.

It should be appreciated that this disclosure is not limited to the specific examples described above and shown in the accompanying drawings, and that various modifications and changes may be made without departing from that scope. The scope of this disclosure is intended to be limited only by the appended claims.

FIG. 11A shows a flow chart of a method for enabling CIIP blocks for MPM candidate list generation according to an example of the present disclosure.

FIG. 11B shows a flow chart of a method for disabling the CIIP block for MPM candidate list generation according to an example of the present disclosure.

FIG. 12 shows the computing environment 12 coupled with the user interface 1260.
10 is shown. The computing environment 1210 can be part of a data processing server. The computing environment 1210 includes a processor 1220, a memory 1240, and an I /.
Includes O interface 1250.

The processor 1220 usually controls the overall operations of the computing environment 1210, such as operations related to display, data acquisition, data communication, and image processing. Processor 1220 may include one or more processors that execute instructions for performing all or several steps of the above method. Further, the processor 1220 is the processor 1
It may include one or more circuits that facilitate the interaction between 220 and other components.
The processor can be a central processing unit (CPU), a microprocessor, a single chip machine, a GPU, and the like.

The memory 1240 is configured to store various types of data to support the operation of the computing environment 1210. Examples of such data include instructions, video data, image data, and the like used in any application or method operating in the computing environment 1210. Memory 1240 is any type of volatile or non-volatile memory device, or a combination thereof, such as static random access memory (SRAM), electrically erasable programmable read-only memory (EEPROM).
, Erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

The I / O interface 1250 provides an interface between the processor 1220 and peripheral interface modules such as keyboards, click wheels, and buttons. Buttons include, but are not limited to, a home button, a scan start button, and a scan stop button. The I / O interface 1250 can be coupled with encoders and decoders.

In one embodiment, a non-temporary computer-readable storage medium comprising a plurality of programs such as those contained in memory 1240, which can be executed by the processor 1220 in the computing environment 1210, is also provided to perform the method described above. Will be done. For example, the non-temporary computer-readable storage medium may be a ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, or the like.

A non-temporary computer-readable storage medium contains a plurality of programs in it for execution by a computing device having one or more processors, the plurality of programs being performed by one or more processors. When executed, the computing device implements the above-mentioned method for predicting behavior.

In one embodiment, the computing environment 1210 is an application specific integrated circuit (ASIC), digital signal processor (DS) for performing the methods described above.
P), digital signal processing device (DSPD), programmable logic device (PL)
D), field programmable gate array (FPGA), graphical processing unit (GPU), controller, microcontroller, microprocessor, or other electronic component.

Claims (26)

Identifying whether the BDOF operation is not applicable further comprises specifying that the BDOF operation is not applicable provided that CIIP is applied to generate the final prediction of the current prediction block. Item 1. The method according to Item 1. Identifying that the BDOF operation is applied further comprises specifying that the BDOF operation is applied when the CIIP is not applied to generate the final prediction of the current prediction block. The method described in. The method of claim 2, wherein the double prediction of the current block is calculated based on averaging the first prediction L0 and the second prediction L1.

To get the reference image in the reference image list associated with the current prediction block,
Generating an inter-prediction based on the first motion vector from the current image to the first reference image,
To get the intra prediction mode associated with the current prediction block,
To generate an intra forecast for the current forecast block based on the intra forecast,
By averaging the inter-forecast and the intra-forecast to generate the final forecast for the current forecast block.
Identifying whether the current forecast block is treated as intermode or intramode for the most likely mode (MPM) based intramode forecast.
How to compromise video coding. The method of claim 6, wherein the reference image list is L0 when the current prediction block is predicted from one reference image in the reference image list L0. The method of claim 6, wherein the reference image list is L1 when the current prediction block is predicted from one reference image in the reference image list L1. When the current prediction block is predicted from one first reference image in the reference image list L0 and one second reference image in the reference image list L1, the reference image list is at L0. The method according to claim 6. When the current prediction block is predicted from one first reference image in the reference image list L0 and one second reference image in the reference image list L1, the reference image list is at L1. The method according to claim 6. The reference image list is said when the current prediction block is predicted from one first reference image in the reference image list L0 and one second reference image in the reference image list L1. The method of claim 6, wherein the image order count (POC) distance to the current image is associated with a smaller reference image. The method of claim 6, wherein the current prediction block is treated as an intermode and the intra prediction mode of the current prediction block is not used for MPM-based intramode prediction. 6. The current prediction block is treated as an intra-mode, and the intra-prediction mode of the current prediction block is used for MPM-based intra-mode prediction.
The method described in.

Identifying whether the BDOF operation is not applicable specifies that the BDOF operation is not applicable provided that the composite inter and intra-prediction (CIIP) are applied to generate the final prediction of the current prediction block. The non-temporary computer-readable storage medium of claim 14, further comprising: Identifying that the BDOF operation is applied further comprises specifying that the BDOF operation is applied when the CIIP is not applied to generate the final prediction of the current prediction block. A non-temporary computer-readable storage medium described in. The non-temporary computer-readable storage according to claim 15, wherein the calculation of the double prediction of the current prediction block is calculated based on the first prediction L0 and the second prediction L1. Medium.

A non-temporary computer-readable storage medium that stores multiple programs executed by a computing device with one or more processors.
When the plurality of programs are executed by the one or more processors,
To get the reference image in the reference image list associated with the current prediction block,
Generating an inter-prediction based on the first motion vector from the current image to the first reference image,
To get the intra prediction mode associated with the current prediction block,
To generate an intra forecast for the current forecast block based on the intra forecast,
By averaging the inter-forecast and the intra-forecast to generate the final forecast for the current forecast block.
Identifying whether the current forecast block is treated as intermode or intramode for the most likely mode (MPM) based intramode forecast.
A non-temporary computer-readable storage medium that causes the computing device to perform an operation including. 19. The non-temporary computer-readable storage medium of claim 19, wherein the reference image list is L0 when the current prediction block is predicted from one reference image in the reference image list L0. 19. The non-temporary computer-readable storage medium of claim 19, wherein the reference image list is L1 when the current prediction block is predicted from one reference image in the reference image list L1. When the current prediction block is predicted from one first reference image in the reference image list L0 and one second reference image in the reference image list L1, the reference image list is at L0. A non-temporary computer-readable storage medium according to claim 19. When the current prediction block is predicted from one first reference image in the reference image list L0 and one second reference image in the reference image list L1, the reference image list is at L1. A non-temporary computer-readable storage medium according to claim 19. The reference image list is said when the current prediction block is predicted from one first reference image in the reference image list L0 and one second reference image in the reference image list L1. 19. The non-temporary computer-readable storage medium of claim 19, wherein the image order count (POC) distance to the current image is associated with a smaller reference image. 19. The non-temporary computer-readable storage medium of claim 19, wherein the current prediction block is treated as an intermode, and the intra prediction mode of the current prediction block is not used for MPM-based intramode prediction. The current prediction block is treated as an intra-mode, and the intra-prediction mode of the current prediction block is used for MPM-based intra-mode prediction, claim 1.
9. The non-temporary computer-readable storage medium according to 9.

Images