JP7303255B2 - Video coding method, video coding device, computer readable storage medium and computer program - Google Patents

Description

This application claims priority to Provisional Application No. 62/790,421, filed January 9, 2019, the entire contents of which are hereby incorporated by reference.

The present application relates to video coding and compression. More specifically, the present application relates to methods and apparatus for complex inter and intra prediction (CIIP) methods for video coding.

Various video coding techniques can be used to compress video data. Video coding is performed according to one or more video coding standards. For example, video coding standards include Versatile Video Coding (VVC), Joint Exploration Test Model (JEM), High Efficiency Video Coding (H.265/HEVC), Advanced Video Coding (H.264/AVC), Video Expert Group (MPEG)
including coding. Video coding generally refers to prediction methods (e.g., inter-prediction, intra-prediction, etc.) that exploit redundancy present in video images or sequences.
take advantage of An important goal of video coding techniques is to compress video data into formats that use lower bit rates while avoiding or minimizing video quality degradation.

Examples of this disclosure provide methods for improving the efficiency of syntactic signaling for merge-related modes.

According to a second aspect of the present disclosure, obtaining a reference image in a reference image list associated with the current predictive block; based on a first motion vector from the current image to the first reference image, , generating an inter prediction; obtaining an intra prediction mode associated with the current prediction block; generating an intra prediction for the current prediction block based on the intra prediction; and the intra prediction to generate a final prediction for the current prediction block; A method of video coding that compromises specifying whether to be treated as a mode or an intra mode.

According to a fourth aspect of the present disclosure, a non-transitory computer-readable storage medium storing instructions is provided. When executed by one or more processors, obtaining a reference image in a reference image list associated with a current prediction block; based on a first motion vector from the current image to a first reference image; obtaining an intra-prediction mode associated with the current prediction block; generating an intra-prediction for the current prediction block based on the intra-prediction;
generating a final prediction for the current prediction block by averaging the inter prediction and the intra prediction;
M) specifying whether the base intra mode prediction is to be treated as an inter mode or an intra mode.

It is to be understood that both the foregoing general description and the following detailed description are examples only and are not restrictive of the present disclosure.

The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate examples consistent with the present disclosure and, together with the description, serve to explain the principles of the disclosure.
1 is a block diagram of an encoder, according to an example of this disclosure; FIG. 1 is a block diagram of a decoder, according to an example of this disclosure; FIG. 4 is a flowchart illustrating a method for generating combined inter and intra prediction (CIIP) according to an example of this disclosure; 4 is a flowchart illustrating a method for generating a CIIP, according to an example of this disclosure; [0014] Figure 4 illustrates block partitions in a multi-type tree structure, according to an example of the present disclosure; [0014] Figure 4 illustrates block partitions in a multi-type tree structure, according to an example of the present disclosure; [0014] Figure 4 illustrates block partitions in a multi-type tree structure, according to an example of the present disclosure; [0014] Figure 4 illustrates block partitions in a multi-type tree structure, according to an example of the present disclosure; [0014] Figure 4 illustrates block partitions in a multi-type tree structure, according to an example of the present disclosure; [0014] FIG. 4 illustrates combined inter and intra prediction (CIIP), according to an example of the present disclosure; [0014] FIG. 4 illustrates combined inter and intra prediction (CIIP), according to an example of the present disclosure; [0014] FIG. 4 illustrates combined inter and intra prediction (CIIP), according to an example of the present disclosure; FIG. 4 is a flowchart of an MPM candidate list generation process, according to an example of the present disclosure; FIG. FIG. 4 is a flowchart of an MPM candidate list generation process, according to an example of the present disclosure; FIG. [0014] Figure 2 illustrates an existing CIIP design workflow in VVC, according to an example of the present disclosure; FIG. 10 illustrates a workflow of the proposed CIIP method by removing BDOF, according to an example of this disclosure; FIG. 12 illustrates a workflow for single-prediction-based CIIP that selects a prediction list based on POC distance, according to an example of the present disclosure; FIG. 4 is a flowchart of a method when validating a CIIP block for MPM candidate list generation, according to an example of the present disclosure; FIG. 4 is a flowchart of a method when disabling CIIP blocks for MPM candidate list generation, according to an example of the present disclosure; 1 illustrates a computing environment coupled with a user interface according to an example of this disclosure; FIG.

Reference will now be made in detail to examples of the disclosure, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings, in which the same numbers in different drawings represent the same or similar elements, unless stated otherwise. The embodiments set forth in the following description of examples of this disclosure do not represent all embodiments consistent with this disclosure. Instead, they are merely examples of apparatus and methods consistent with related aspects of the present disclosure as recited in the appended claims.

The terminology used in this disclosure is for the purpose of describing particular embodiments only,
It is not intended to limit the disclosure. As used in this disclosure and the appended claims, the singular forms "a,""an," and "the" are intended to include plural forms as well, unless the context clearly indicates otherwise. ing. It should also be understood that the term "and/or" as used herein means and is intended to include any and all possible combinations of one or more of the associated listed items.

It is understood that terms such as “first,” “second,” “third,” etc. may be used herein to describe various information, but the information should not be limited by these terms. want to be These terms are only used to distinguish one category of information from another. For example, first information could be termed second information, and, similarly, second information could be termed first information, without departing from the scope of the present disclosure. As used herein, the term "if" may be used interchangeably with "when,""when," or "when," depending on the context.
It may be understood to mean "according to judgment".

The first version of the HEVC standard was completed in October 2013 and replaces the previous generation video coding standard H.365. It offers about 50% bitrate savings or comparable perceptual quality compared to H.264/MPEG AVC. Although the HEVC standard offers significant coding improvements over its predecessor, there is evidence that adding coding tools to HEVC can achieve superior coding efficiency. Based on this, VCEG and MPE
Both G have initiated research work on new coding technologies for future video coding standardization. In October 2015, the ITU-TVECG and ISO/IE
A Joint Video Exploration Team (JVET) was formed by C MPEG. One reference software, called the Joint Exploration Model (JEM), integrates some additional coding tools on top of the HEVC Test Model (HM) to develop the JVE
maintained by T.

In October 2017, a Joint Call for Proposals (CfP) on video compression with features beyond HEVC was published by ITU-T and ISO/IEC. In April 2018, at the 10th JVET conference, 23 CfP responses were received and evaluated, approximately 40% higher than HEVC
of compression efficiency gains were demonstrated. Based on these evaluation results, JVET will recommend Versatil
We launched a new project to develop a new generation video coding standard called e Video Coding (VVC). In the same month, a reference software codebase called the VVC Test Model (VTM) was established to demonstrate a reference implementation of the VVC standard.

Like HEVC, VVC is built on a block-based hybrid video coding framework. FIG. 1 (discussed below) provides a block diagram of a typical block-based hybrid video coding system. An input video signal is processed in blocks, called coding units (CUs). In VTM-1.0, C
U can be up to 128x128 pixels. However, unlike HEVC, which partitions blocks based only on quadtrees, in VVC, one coding tree unit (CTU) is divided into CUs to accommodate different local characteristics based on quad/binary/ternary trees. divided into Furthermore, the concept of multiple partition unit types in HEVC is removed, i.e. the separation of CUs, prediction units (PUs) and transform units (TUs) no longer exists in VVC, instead each CU always has an additional partition used as the basic unit for both prediction and transformation without In a multi-type tree structure, one CTU is first partitioned by a quadtree structure. Each quadtree leaf node can then be further partitioned in a binary and ternary tree structure.
As shown in FIGS. 5A, 5B, 5C, 5D, 5D, and 5E (described below), quaternary partitioning, horizontal binary partitioning, vertical binary partitioning, and horizontal There are five partition types: ternary partitioning and vertical ternary partitioning.

In FIG. 1 (described below), spatial prediction and/or temporal prediction can be performed.
Spatial prediction (or “intra prediction”) uses pixels from samples of already coded neighboring blocks (called reference samples) in the same video picture/slice to predict the current video block. Spatial prediction reduces the spatial redundancy inherent in video signals. Temporal prediction (also called "inter-prediction" or "motion-compensated prediction".
) predicts the current video block using reconstructed pixels from an already coded video image. Temporal prediction reduces the temporal redundancy inherent in video signals. A temporal prediction signal for a particular CU is typically signaled by one or more motion vectors (MVs) that indicate the amount and direction of motion between the current CU and its temporal reference. Also, if multiple reference pictures are supported, one additional reference picture index is sent. This is used to identify which reference picture in the reference picture store the temporal prediction signal comes from. After spatial and/or temporal prediction, a mode decision block in the encoder selects the optimal prediction mode, eg, based on a rate-distortion optimization method. The prediction block is then subtracted from the current video block and the prediction residual is decorrelated using transform and quantization.

The quantized residual coefficients are inverse quantized and inverse transformed to form reconstructed residuals, which are then added to the prediction block to form the reconstructed signal of the CU. Further in-loop filtering, such as deblocking filter, sample adaptive offset (SAO), and adaptive in-loop filter (ALF), can be applied to the reconstructed CU before being placed in the reference image store and used for coding future video blocks. can be applied to To form the output video bitstream, the coding mode (inter or intra), prediction mode information, motion information, and quantized residual coefficients are all sent to an entropy coding unit where they are further compressed and packed into bits. form a stream.

FIG. 2 (discussed below) shows a general block diagram of a block-based video decoder. A video bitstream is first entropy decoded in an entropy decoding unit. The coding mode and prediction information are sent to either the spatial prediction unit (if intra-coded) or the temporal prediction unit (if inter-coded) to form a predicted block. The residual transform coefficients are sent to an inverse quantization unit and an inverse transform unit to reconstruct a residual block. The prediction block and residual block are then added together. The reconstructed blocks can be further passed through in-loop filtering before being stored in the reference image store. The reconstructed video in the reference image store is then sent to drive a display device and also used to predict future video blocks.

FIG. 1 shows a typical encoder 100. As shown in FIG. Encoder 100 receives video input 110,
Motion compensation 112, motion estimation 114, intra/inter mode decision 116, block predictor 140, adder 128, transform 130, quantization 132, prediction related information 142, intra prediction 118, image buffer 120, inverse quantization 134, inverse It has transform 136 , adder 126 , memory 124 , in-loop filter 122 , entropy coding 138 and bitstream 144 .

FIG. 2 shows a block diagram of a typical decoder 200. As shown in FIG. Decoder 200 includes bitstream 210, entropy decoding 212, inverse quantization 214, inverse transform 216, adder 2
18, intra/inter mode selection 220, intra prediction 222, memory 230, in-loop filter 228, motion compensation 224, image buffer 226, prediction related information 234, and video output 232;

FIG. 3 illustrates an example method 300 for generating combined inter and intra prediction (CIIP) according to this disclosure.

At step 310, a first reference image associated with the current prediction block and a second
Get a reference image of where the first reference image precedes the current image in display order and the second
The reference image for is after the current image in display order.

At step 312, a first prediction L0 is obtained based on the first motion vector MV0 from the current prediction block to the reference block in the first reference picture.

At step 314, a second prediction L1 is obtained based on the second motion vector MV1 from the current prediction block to the reference block in the second reference picture.

FIG. 4 shows an exemplary method for generating a CIIP according to this disclosure. For example, the method includes single-prediction-based inter-prediction and MPM-based intra-prediction to generate CIIP.

At step 410, a reference image in the reference image list associated with the current prediction block is obtained.

At step 412, an inter prediction is generated based on the first motion vector from the current picture to the first reference picture.

At step 414, the intra-prediction mode associated with the current prediction block is obtained.

At step 416, an intra-prediction for the current prediction block is generated based on the intra-prediction.

At step 418, the inter-prediction and intra-prediction are averaged to generate a final prediction for the current prediction block.

At step 420, the current prediction block is the most likely mode (MPM)
Specifies whether the base intra mode prediction is treated as an inter mode or an intra mode.

FIG. 5A shows a diagram illustrating block quaternary partitions in a multi-type tree structure, according to an example of this disclosure.

FIG. 5B shows a diagram illustrating block vertical binary partitions in a multi-type tree structure, according to an example of this disclosure.

FIG. 5C shows a diagram illustrating block-horizontal binary partitions in a multi-type tree structure, according to an example of this disclosure.

FIG. 5D shows a diagram illustrating block vertical ternary partitions in a multi-type tree structure, according to an example of this disclosure.

FIG. 5E shows a diagram illustrating a block-horizontal ternary partition in a multi-type tree structure, according to an example of this disclosure.

Combined Inter and Intra Prediction As shown in FIGS. 1 and 2, inter and intra prediction methods are used in hybrid video coding schemes. Here, each PU is allowed to choose inter-prediction or intra-prediction to exploit correlations in either the temporal or spatial domain only, but not both. However, as pointed out in the prior literature, the residual signals produced by inter-predicted and intra-predicted blocks can exhibit very different characteristics from each other. Therefore, if two types of prediction can be efficiently combined, one more accurate prediction can be expected to reduce the energy of prediction residuals and improve coding efficiency. In addition, natural video content can complicate the motion of moving objects. For example, there may be regions that contain both old content (e.g. objects included in previously coded images) and new new content (e.g. objects excluded in previously coded images) . In such scenarios, neither inter-prediction nor intra-prediction can provide an accurate prediction of one of the current blocks.

To further improve the prediction efficiency, the VVC standard adopts composite inter and intra prediction (CIIP), which combines intra and inter prediction of one CU coded by merge mode. Specifically, for each merge-CU, one additional flag is signaled to indicate whether CIIP is enabled for the current CU. For the luma component, CIIP supports four frequently used intra modes, including planar mode, DC mode, horizontal mode, and vertical mode. For the chroma component, DM (ie chroma reuses the same intra mode of the luma component) is always applied without additional signaling. In addition, existing CI
In IP design, a weighted average is applied to combine the inter-predicted and intra-predicted samples of one CIIP CU. Specifically, equal weighting (ie, 0.5) is applied when planar or DC mode is selected. Otherwise (i.e., either horizontal or vertical mode applies), the current CU is initially divided into four equal-sized regions horizontally (for horizontal mode) or vertically (for vertical mode). divided into

Furthermore, in the current VVC operating specification, the intra mode of one CIIP CU is used as a predictor to predict the intra mode of its neighboring CIIP CUs via the most probable mode (MPM) mechanism. can Specifically, each CI
For an IP CU, if its neighboring blocks are also CIIP CUs, the intra modes of those neighboring blocks are first: planar mode, DC mode, horizontal mode,
and rounded to the nearest mode within the vertical mode, then added to the current CU's MPM candidate list. However, when constructing the MPM list for each intra-CU, one of its neighboring blocks is considered unavailable if it is coded in CIIP mode. That is, the intra-modes of one CIIP CU are not allowed to predict the intra-modes of its neighboring intra-CUs. Figures 7A and 7B (discussed below) compare the MPM list generation process for intra and CIIP CUs.

where shift and o _offset are 15-BD and 1<<(14-BD)+2*(1<<13
), which is the right shift and offset values applied to combine the double-predicted L0 and L1 prediction signals.

FIG. 6A shows a diagram illustrating horizontal mode combined inter and intra prediction, according to an example of this disclosure.

FIG. 6B shows a diagram illustrating composite inter and intra prediction in vertical mode, according to an example of this disclosure.

FIG. 6C shows a diagram illustrating combined inter and intra prediction for planar and DC modes, according to an example of this disclosure.

FIG. 7A shows a flowchart of an intra-CUS MPM candidate list generation process, according to an example of this disclosure.

FIG. 7B shows a flowchart of a CIIP CU's MPM candidate list generation process, according to an example of this disclosure.

Improvements over CIIP Although CIIP can increase the efficiency of conventional motion-compensated prediction, its design can be further improved. Specifically, the following problems in existing CIIP designs in VVC are identified in this disclosure.

First, as explained in the "Combined Inter and Intra Prediction" section, CIIP
To combine inter and intra prediction samples, each CIIP CU needs to use its reconstructed neighboring samples to generate a prediction signal. This is one CII
It means that the decoding of a PCU depends on perfect reconstruction of its neighboring blocks. Because of these interdependencies, in practical hardware implementations CIIP should be performed at the reconstruction stage when adjacent reconstructed samples are available for intra-prediction. Since the decoding of CUs in the reconstruction stage must be performed sequentially (i.e., one by one), the number of computational operations (e.g., multiplications, additions, bit shifts) involved in the CIIP process is limited to real-time decoding. It cannot be too high to ensure sufficient throughput.

As mentioned in the “Bidirectional Optical Flow” section, BDOF has a prediction quality of Enabled to improve. As shown in FIG. 8 (discussed below), in current VVC, BDOF is also involved to generate inter-prediction samples for CIIP mode. Given the additional complexity with BDOF, such a design may not be suitable for hardware codec encoding/encoding when CIIP is enabled.
Decoding throughput can be significantly reduced.

Next, in the current CIIP design, motion-compensated prediction signals for both lists L0 and L1 need to be generated when one CIIP CU references one merge candidate that is double-predicted. In cases where one or more MVs are not integer precision, an additional interpolation process must be invoked to interpolate samples at partial sample positions.
Such a process not only increases computational complexity, but also increases memory bandwidth if more reference samples need to be accessed from external memory.

Then, as discussed in the “Combined Inter and Intra Prediction” section, the current CI
In IP design, the intra mode of CIIP CUs and the intra mode of intra CUs are treated differently when constructing the MPM lists of their neighboring blocks. Specifically, if one current CU is coded in CIIP mode, its neighboring CIIP CU is considered intra, i.e. the intra mode of the neighboring CIIP CU is added to the MPM candidate list. can However, if the current CU is coded in intra mode, its neighboring CIIP CU is considered inter, i.e. the intra mode of the neighboring CIIP CU is excluded from the MPM candidate list. Such non-uniform designs may not be optimal for the final version of the VVC standard.

FIG. 8 shows a diagram illustrating an existing CIIP design workflow in VVC, according to an example of this disclosure.

Simplifying CIIP In this disclosure, methods are provided to simplify existing CIIP designs to facilitate hardware codec implementation. In general, the main aspects of the technology proposed in this disclosure are summarized as follows.

First, to improve the CIIP coding/decoding throughput, it is proposed to exclude BDOF from inter-prediction sample generation in CIIP mode.

Then, to reduce computational complexity and memory bandwidth consumption, one CIIP
In the case where the CU is doubly predicted (ie, has both L0 and L1 MVs), a method is proposed to convert the block from doubly predicted to uni-predicted to generate inter-predicted samples.

Then, two methods are proposed to harmonize intra-CU and CIIP intra-modes when forming MPM candidates for neighboring blocks.

CIIP without BDOF
As pointed out in the "problem statement" section, BDOF is a
Always enabled to generate inter-predicted samples for CIIP mode when U is doubly predicted. Due to the additional complexity of BDOF, existing CIIP designs can suffer from significantly lower encoding/decoding throughput, especially real-time decoding can be difficult for VVC decoders. On the other hand, CIIP
For a CU, its final prediction sample is generated by averaging the inter-prediction and intra-prediction samples. In other words, the BDOF-improved prediction samples are not directly used as prediction signals for the CIIP CU. Therefore, the corresponding improvement obtained from BDOF is less efficient for CIIP CU when compared to conventional doubly-predicted CU, where BDOF is directly applied to generate prediction samples. Therefore, based on the above circumstances, it is proposed to disable BDOF when generating CIIP mode inter-prediction samples. FIG. 9 (discussed below) shows the corresponding workflow of the proposed CIIP process after removing the BDOF.

FIG. 9 shows a diagram illustrating the workflow of the proposed CIIP method by removing BDOF, according to an example of this disclosure.

CIIP based on a single prediction
As described above, when a merge candidate referenced by one CIIP CU is double predicted, both L0 and L1 prediction signals are generated to predict the samples within the CU. To reduce memory bandwidth and interpolation complexity, in one embodiment of the present disclosure, (current CU
Only inter-predicted samples generated using uni-prediction (even if is doubly-predicted) will be used to combine with intra-predicted samples in CIIP mode. Specifically, in the case where the current CIIP CU is uni-prediction, the inter-prediction samples are
Directly combined with intra-prediction samples. Otherwise (i.e., if the current CU is doubly predicted), the inter-prediction samples used by CIIP are generated based on a single prediction from one prediction list (L0 or L1). be. Various methods can be applied to select the prediction list. A first method proposes to always choose the first prediction (ie list L0) for any CIIP block predicted by two reference pictures.

A second method proposes to always choose the second prediction (ie list L1) for any CIIP block predicted by two reference pictures. In a third method, one adaptive method is applied if a prediction list associated with one reference picture with a small picture order count (POC) distance from the current picture is selected. FIG. 10 (discussed below) shows the workflow of single-prediction-based CIIP, which selects a prediction list based on POC distance.

Finally, the last method proposes to enable CIIP mode only if the current CU is uni-predicted. Furthermore, to reduce overhead, CII
The signaling of the enable/disable flag of P depends on the prediction direction of the current CIIP CU. In case the current CU is uni-predicted, a CIIP flag is signaled in the bitstream to indicate whether CIIP is enabled or disabled. Otherwise (ie, if the current CU is double-predicted), signaling of the CIIP flag is skipped and always assumed to be false, ie CIIP is always disabled.

FIG. 10 shows a diagram illustrating a workflow for single-prediction-based CIIP that selects a prediction list based on POC distance, according to an example of this disclosure.

Harmonizing Intra-CU and CIIP Intra-Modes for MPM Candidate List Construction As mentioned above, the current CIIP design uses intra-CU and CIIP CU's intra-modes to form the MPM candidate list of their neighboring blocks. method is not uniform. Specifically, both the intra CU and the intra mode of the CIIP CU can predict the intra mode of neighboring blocks coded in the CIIP mode.
However, the intra mode of the intra CU can be predicted only with the intra mode of the intra CU. To achieve another unified design, two methods are proposed in this section, harmonizing the usage of intra-CU and CIIP's intra-mode for MPM list construction.

The first method proposes to treat the CIIP mode as an inter mode for MPM list construction. Specifically, one CIIP CU or one intra CU
When generating an MPM list for either of , if the adjacent block is coded in CIIP mode, the intra mode of the adjacent block is marked as disabled.
In such a method, the intra mode of the CIIP block cannot be used to configure the MPM list. Conversely, the second method proposes to treat the CIIP mode as an intra mode for MPM list construction. Specifically, in this method, CII
In intra mode of PCU, intra mode of both adjacent CIIP blocks and intra blocks can be predicted. 11A and 11B (discussed below) illustrate the MPM candidate list generation process when the above two methods are applied.

Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This application, in accordance with its general principles, covers any variations, uses,
or intended to cover conformance. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.

It is to be understood that this disclosure is not limited to the specific examples described above and illustrated in the accompanying drawings, and that various modifications and changes may be made without departing from its scope. It is intended that the scope of this disclosure be limited only by the claims appended hereto.

FIG. 11A shows a flowchart of a method when enabling a CIIP block for MPM candidate list generation, according to an example of this disclosure.

FIG. 11B shows a flowchart of a method when disabling CIIP blocks for MPM candidate list generation, according to an example of this disclosure.

FIG. 12 illustrates computing environment 12 coupled with user interface 1260
10 is shown. Computing environment 1210 may be part of a data processing server. Computing environment 1210 includes processor 1220, memory 1240, I/O
0 interface 1250 .

Processor 1220 typically controls the overall operation of computing environment 1210, such as operations associated with display, data acquisition, data communication, and image processing. Processor 1220 may include one or more processors that execute instructions to perform all or some steps of the above methods. In addition, processor 1220 may include processor 1
It may include one or more circuits that facilitate interaction between 220 and other components.
A processor may be a central processing unit (CPU), a microprocessor, a single-chip machine, a GPU, or the like.

Memory 1240 is configured to store various types of data to support operation of computing environment 1210 . Examples of such data include instructions, video data, image data, etc. for any application or method operating in computing environment 1210 . Memory 1240 may be any type of volatile or non-volatile memory device or combination thereof, such as static random access memory (SRAM), electrically erasable programmable read only memory (EEPROM).
, erasable programmable read-only memory (EPROM), programmable read-only memory (PROM), read-only memory (ROM), magnetic memory, flash memory, magnetic disk or optical disk.

I/O interface 1250 provides an interface between processor 1220 and peripheral interface modules such as keyboards, click wheels, buttons, and the like. Buttons include, but are not limited to, a home button, a start scan button, and a stop scan button. The I/O interface 1250 can be coupled with encoders and decoders.

One embodiment also provides a non-transitory computer-readable storage medium containing a plurality of programs, such as those contained in memory 1240, executable by processor 1220 in computing environment 1210 to perform the methods described above. be done. For example, a non-transitory computer-readable storage medium can be ROM, RAM, CD-ROM, magnetic tape, floppy disk, optical data storage device, and the like.

A non-transitory computer-readable storage medium having stored therein a plurality of programs for execution by a computing device having one or more processors, the plurality of programs being executed by the one or more processors. When executed, the computing device will perform the method for predicting behavior described above.

In one embodiment, the computing environment 1210 includes one or more application specific integrated circuits (ASICs), digital signal processors (DS
P), Digital Signal Processing Device (DSPD), Programmable Logic Device (PL
D), can be implemented by a field programmable gate array (FPGA), graphical processing unit (GPU), controller, microcontroller, microprocessor or other electronic component.

Claims (16)

obtaining a reference image in a reference image list associated with the current coding block;
generating an inter-prediction based on motion vectors from a current image to the reference image;
obtaining an intra-prediction mode associated with the current coding block;
generating an intra prediction for the current coding block based on the intra prediction mode;
weighted averaging the inter prediction and the intra prediction to generate a final prediction for the current coding block;
specifying that the current coding block is to be treated as inter mode and disabling intra mode for the current coding block when a most probable mode (MPM) list of neighboring coding blocks is constructed; marking and
A method of video coding comprising:
A method of video coding, wherein a bidirectional optical flow (BDOF) operation is disabled for the current coding block. 2. The method of claim 1, wherein the reference picture list is L0 when the current coding block is predicted from one reference picture in the reference picture list L0. The method of claim 1, wherein the reference picture list is L1 when the current coding block is predicted from one reference picture in the reference picture list L1. The reference picture list is L0 when the current coding block is predicted from one first reference picture in the reference picture list L0 and one second reference picture in the reference picture list L1. 2. The method of claim 1, wherein there is The reference picture list is L1 when the current coding block is predicted from one first reference picture in the reference picture list L0 and one second reference picture in the reference picture list L1. 2. The method of claim 1, wherein there is When the current coding block is predicted from one first reference image in the reference image list L0 and one second reference image in the reference image list L1, the reference image list includes the 2. The method of claim 1, wherein the picture order count (POC) distance to the current picture is the one associated with the smaller reference picture. 2. The method of claim 1, wherein the current coding block is treated as inter-mode for MPM-based intra-mode prediction. A video coding device comprising one or more processors and one or more storage devices coupled to the one or more processors,
obtaining a reference image in a reference image list associated with the current coding block;
generating an inter-prediction based on motion vectors from a current image to the reference image;
obtaining an intra-prediction mode associated with the current coding block;
generating an intra prediction for the current coding block based on the intra prediction mode;
weighted averaging the inter prediction and the intra prediction to generate a final prediction for the current coding block;
specifying that the current coding block is to be treated as inter mode and disabling intra mode for the current coding block when a most probable mode (MPM) list of neighboring coding blocks is constructed; marking and
A video coding device configured to perform an operation comprising:
A video coding device , wherein bidirectional optical flow (BDOF) operation is disabled for the current coding block. 9. The video coding device of claim 8, wherein the reference picture list is L0 when the current coding block is predicted from one reference picture in the reference picture list L0. 9. The video coding device of claim 8, wherein the reference picture list is L1 when the current coding block is predicted from one reference picture in the reference picture list L1. The reference picture list is L0 when the current coding block is predicted from one first reference picture in the reference picture list L0 and one second reference picture in the reference picture list L1. 9. The video coding device of claim 8, wherein a The reference picture list is L1 when the current coding block is predicted from one first reference picture in the reference picture list L0 and one second reference picture in the reference picture list L1. 9. The video coding device of claim 8, wherein a The reference picture list is such that the current coding block corresponds to the reference picture list L0.
and one reference image in the reference image list L1 that has a smaller picture order count (POC) distance to the current image when predicted from one second reference image in the reference image list L1. 9. A video coding device according to claim 8, associated with an image. 9. The video coding device of claim 8, wherein the current coding block is treated as inter-mode for MPM-based intra-mode prediction. A non-transitory computer-readable storage medium storing a plurality of programs to be executed by a computing device having one or more processors,
A non-transitory computer-readable storage medium that, when executed by the one or more processors, causes the computing device to perform the method of any one of claims 1 to 7. A computer program comprising instructions for performing the steps of the method according to any one of claims 1 to 7 when executed by a processor.

Images