WO2020001591A1

WO2020001591A1 - Decoding and encoding methods and apparatus thereof

Info

Publication number: WO2020001591A1
Application number: PCT/CN2019/093574
Authority: WO
Inventors: 陈方栋; 王莉
Original assignee: 杭州海康威视数字技术股份有限公司
Priority date: 2018-06-28
Filing date: 2019-06-28
Publication date: 2020-01-02
Also published as: CN110662033B; CN110662033A

Abstract

The present application provides a decoding method, an encoding method, and a corresponding apparatus, an example of the method comprising: acquiring motion information of a candidate image block of a present image block; acquiring a template of the present image block according to the motion information of the candidate image block; and decoding the present image block according to the template of the present image block.

Description

Decoding and encoding method and equipment

Technical field

The present application relates to the technical field of video encoding and decoding, and in particular, to a decoding and encoding method and a device thereof.

Background technique

In order to achieve the purpose of saving space, the images in the video are transmitted after being encoded. A complete video encoding method may include prediction, transformation, quantization, entropy encoding, and filtering. Among them, predictive coding includes intra coding and inter coding. Inter-frame coding uses the correlation of the video time domain to predict the pixels of the current image by using the pixels adjacent to the encoded image to effectively remove the video time domain redundancy.

In video coding technology, the coding process is performed on a block-by-block basis. When encoding the current image block, reconstruction information of surrounding coded image blocks is available, and a template (Template) refers to decoding information of a fixed shape around the current image block (adjacent regions in the time or space domain). The template is exactly the same at the encoding and decoding ends. Therefore, some operations performed by the template on the encoding side can obtain completely consistent results on the decoding side. In other words, the information derived by the encoder based on the template can be recovered losslessly at the decoder without the need to pass additional information, which can further reduce the number of transmitted bits.

However, the traditional template generation method has problems such as low decoding efficiency and large decoding delay.

Summary of the invention

The application provides a decoding and encoding method and a device thereof, which can help improve decoding efficiency, reduce decoding delay, and improve encoding and decoding performance.

This application provides a decoding method, which is applied to a decoding end. The method includes: acquiring motion information of a candidate image block of a current image block; acquiring a template of the current image block according to the motion information of the candidate image block; The template of the current image block decodes the current image block.

The present application provides an encoding method, which is applied to an encoding end. The method includes: acquiring motion information of a candidate image block of a current image block; acquiring a template of the current image block according to the motion information of the candidate image block; The template of the current image block encodes the current image block to obtain an encoded bit stream corresponding to the current image block; and sends the encoded bit stream to a decoding end.

This application provides a decoding device, which includes a processor and a machine-readable storage medium. The machine-readable storage medium stores machine-executable instructions that can be executed by the processor; the processor is configured to execute the machine-executable instructions to implement the foregoing method steps.

This application provides an encoding end device, which includes a processor and a machine-readable storage medium. The machine-readable storage medium stores machine-executable instructions that can be executed by the processor; the processor is configured to execute the machine-executable instructions to implement the foregoing method steps.

As can be seen from the above technical solutions, in the embodiment of the present application, a template of the current image block may be obtained according to the motion information of the candidate image block of the current image block, and the current image block may be decoded according to the template of the current image block. The above method can quickly obtain the template of the current image block, which can effectively improve decoding efficiency, reduce decoding delay, and improve encoding and decoding performance.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a flowchart of an encoding method according to an embodiment of the present application.

2A-2O are schematic diagrams of a template of a target image block in an embodiment of the present application.

3A-3D are flowcharts of an encoding method in another embodiment of the present application.

FIG. 4 is a flowchart of a decoding method according to an embodiment of the present application.

FIG. 5 is a flowchart of a decoding method in another embodiment of the present application.

FIG. 6 is a structural diagram of a decoding device according to an embodiment of the present application.

FIG. 7 is a block diagram of an encoding device according to an embodiment of the present application.

FIG. 8 is a hardware structural diagram of a decoder device in an embodiment of the present application.

FIG. 9 is a hardware structural diagram of an encoding end device in an embodiment of the present application.

detailed description

The terminology used in the embodiments of the present application is for the purpose of describing particular embodiments only, and is not intended to limit the present application. The singular forms "a", "the" and "the" used in this application and the claims are also intended to include the plural forms unless the context clearly indicates otherwise. It should also be understood that the term "and / or" as used herein refers to any or all possible combinations that include one or more of the associated listed items.

It should be understood that although the terms first, second, third, etc. may be used to describe various information in the embodiments of the present application, these terms are only used to distinguish the same type of information from each other. For example, without departing from the scope of the present application, the first information may also be referred to as the second information, and similarly, the second information may also be referred to as the first information. Depending on the context, the word "if" can be interpreted as "at" or "at ..." or "in response to a determination".

A method for decoding and encoding is proposed in the embodiment of the present application. The method may involve the following concepts:

Motion Vector (MV): In inter-frame coding, a motion vector is used to represent a relative displacement between a current image block of a current frame image and a reference image block of a reference frame image. For example, there is a strong time-domain correlation between image A of the current frame and image B of the reference frame. When transmitting image block A1 (current image block) of image A, you can perform a motion search in image B to find the image block A1 best matches image block B1 (reference image block), and determines the relative displacement between image block A1 and image block B1. This relative displacement is also the motion vector of the image block A1. Among them, each image block has a corresponding motion vector transmitted to the decoding end. If the motion vector of each image block is independently encoded and transmitted, it consumes a considerable number of bits. In order to reduce the number of bits used to encode the motion vector, the spatial correlation between adjacent image blocks can be used to predict the motion vector of the current image block to be encoded according to the motion vector of the adjacent encoded image block, and then the prediction difference is For encoding.

Motion information (Information): In order to accurately point to an image block, in addition to acquiring motion vectors, index information of a reference frame image is required to indicate which reference frame image is used. For the current frame image, a reference frame image list can usually be established. The reference frame index indicates that the current image block uses the reference frame image in the reference frame image list. Motion-related information such as motion vectors and reference frame indexes can be collectively referred to as motion information.

Template: In video coding technology, the coding process is performed on an image-by-image block basis. When encoding the current image block, reconstruction information of the surrounding coded image blocks is available. The template refers to the encoding / decoding information of a fixed shape around the current image block (adjacent areas in the time domain or the spatial domain). The template is exactly the same at the encoding and decoding ends. Therefore, some operations performed by the template on the encoding end can be used to obtain completely consistent results on the decoding end. In other words, the information derived by the encoder based on the template can be recovered losslessly at the decoder without the need to pass additional information, which can further reduce the number of transmitted bits.

Rate-Distortion Optimized: There are two major indicators for evaluating coding efficiency: bit rate (also known as Bit Rate, Second, BPS) and PSNR (Peak Signal to Noise Ratio, peak signal-to-noise ratio). For the same video, the smaller the encoded bitstream, the greater the compression ratio; the larger the PSNR, the better the reconstructed image quality. In the mode selection, the discrimination formula is essentially a comprehensive evaluation of the two. For example, the cost of the model:

J (mode) = D + λ * R.

Among them, D represents Distortion (distortion), which can usually be measured using the SSE (Sum-Square Error) index. SSE refers to the mean square sum of the difference between the reconstructed image block and the source image; λ is the Lagrange multiplier, R is the actual number of bits required for image block coding in this mode, including the sum of the bits required for coding mode information, motion information, and residuals.

Intra prediction (intraprediction) refers to the use of reconstructed pixel values of spatially adjacent image blocks of the current image block (that is, in the same frame image as the current image block) for predictive encoding.

Inter prediction (inter prediction) refers to the use of reconstructed pixel values of time-domain neighboring image blocks of the current image block (in a different frame image from the current image block) for predictive coding.

The following describes in detail the decoding method and the encoding method provided by the present disclosure in combination with several specific embodiments.

Embodiment one:

Referring to FIG. 1, which is a schematic flowchart of an encoding method, the method may include the following steps:

Step 101: The encoder obtains motion information of a candidate image block of the current image block.

The candidate image block of the current image block may include, but is not limited to, a spatial-domain candidate image block of the current image block; or a time-domain candidate image block of the current image block. There are no restrictions on this candidate image block.

When encoding the current image block, since the candidate image block of the current image block has been encoded, that is, the motion information of the candidate image block is known, the encoder can directly obtain the motion information of the candidate image block, such as the candidate image block. The motion vector and reference frame index are not limited.

Step 102: The encoder obtains a template of the current image block according to the motion information of the candidate image block.

For the processing procedure of this step 102, refer to the subsequent embodiments.

Step 103: The encoding end encodes the current image block according to the template of the current image block to obtain an encoded bit stream corresponding to the current image block.

Encoding the current image block according to the template of the current image block to obtain the encoded bit stream corresponding to the current image block may include, but is not limited to: obtaining the original mode information of the current image block; obtaining based on the template and original mode information of the current image block, obtaining Target mode information of the current image block; encoding the current image block according to the target mode information to obtain a coded bit stream corresponding to the current image block. The original mode information is the original motion vector, and the target mode information is the target motion vector. Or, the original mode information is the original motion vector and the original reference frame, and the target mode information is the target motion vector and the target reference frame. Or, the original mode information is The original prediction image block, and the target mode information is the target prediction image block. Of course, the above is only an example, and there is no limitation on this.

Step 104: The encoding end sends the encoded bit stream to the decoding end.

When the encoding end encodes the current image block according to the target mode information, the encoding bit stream corresponding to the current image block sent by the encoding end to the decoding end may carry first instruction information, where the first instruction information is used to instruct the decoding end to base on the current image The template and original mode information of the block obtain the target mode information of the current image block. When the encoding end encodes the current image block according to the original mode information, the bit stream corresponding to the current image block sent by the encoding end to the decoding end may carry second instruction information, and the second instruction information is used to instruct the decoding end to pair the original image information based on the original mode information. Decode the current image block.

In the above manner, the first instruction information or the second instruction information is notified in an explicit manner. In practical applications, the notification may also be performed in an implicit manner, that is, the first indication information or the second indication information is not carried in the encoded bit stream corresponding to the current image block. Specifically, the encoding end and the decoding end may also negotiate a decision strategy or define a decision strategy in a standard, and store the decision strategies on the encoding end and the decoding end, respectively. For example, the decision strategy may agree on first strategy information, and the first strategy information is used to indicate that target mode information of the current image block is obtained based on a template of the current image block and original mode information. Alternatively, the decision strategy may agree on the second strategy information, and the second strategy information is used to instruct the current image block to be decoded based on the original mode information. Alternatively, the decision strategy may agree on the third strategy information, and the third strategy information is the same strategy information as the candidate image block of the current image block.

On this basis, when the decision strategy agrees with the first strategy information and the encoding end encodes the current image block according to the target mode information, the encoded bit stream corresponding to the current image block may not carry the first indication information and the second indication information. When the decision strategy agrees on the second strategy information and the encoding end encodes the current image block according to the original mode information, the encoded bit stream corresponding to the current image block may not carry the first indication information and the second indication information. When the decision strategy agrees on the third strategy information, and the candidate image block uses the first strategy information, and the encoding end encodes the current image block according to the target mode information, the encoded bit stream corresponding to the current image block may not carry the first indication information and The second instruction information. When the decision strategy agrees with the third strategy information, and the candidate image block adopts the second strategy information, and the encoding end encodes the current image block according to the original mode information, the encoded bit stream corresponding to the current image block may not carry the first indication information and The second instruction information.

It can be seen from the above that the template of the current image block can be obtained according to the motion information of the candidate image block of the current image block, and the current image block is encoded according to the template of the current image block to obtain the encoded bit stream corresponding to the current image block. The above method can quickly obtain the template of the current image block, which can effectively improve encoding efficiency, reduce encoding delay, and improve encoding performance.

Embodiment two:

In the video encoding process, each image block of each frame of image is encoded one by one. When encoding the current image block, if the adjacent image blocks around the current image block have been reconstructed, the encoding information of the adjacent image blocks can be used. Reconstruct the current image block. For example, the encoding information of the neighboring image blocks of the current image block can be used to obtain the template of the current image block. The encoding information may include, but is not limited to, reconstruction information and / or prediction information of neighboring image blocks. The reconstruction information may include, but is not limited to, a luminance value, a chrominance value, and the like. The prediction information may be an intermediate value capable of obtaining reconstruction information. For example, if a luminance value can be obtained using the intermediate value, the intermediate value is prediction information, and the present disclosure does not limit the prediction information.

Among them, if the encoding information includes reconstruction information, the generation of the template of the current image block needs to wait until the reconstruction stage, which greatly reduces the efficiency of encoding and decoding, and brings the delay of encoding and decoding. If the encoding information includes prediction information, the generation of the template of the current image block also needs to wait until the reconstruction stage, which greatly reduces the efficiency of encoding and decoding and brings about the delay of encoding and decoding. Therefore, the above-mentioned method will greatly affect the parallelism of encoding and decoding.

In view of the above findings, in this embodiment, a template that can acquire a current image block according to the motion information (such as a motion vector and a reference frame index) of a candidate image block of the current image block is proposed. In addition, both the encoding end and the decoding end can apply the method for obtaining a template of the current image block according to the motion information of the candidate image block.

Obtaining a template of the current image block according to the motion information of the candidate image block may include: when the motion information of the candidate image block includes a motion vector of the candidate image block and a reference frame index, determining the candidate image block ’s A reference frame image; obtaining a reference image block of the candidate image block from the reference frame image according to the motion vector, and obtaining a template of the current image block according to the reference image block.

For example, referring to FIG. 2A, assume that image block A1 is the current image block, and image blocks A2 and A3 are candidate image blocks of image block A1. If the reference frame index of the image block A2 is the index of the image B, it can be determined that the reference frame image of the image block A2 is the image B according to the reference frame index; then, the image block B2 corresponding to the image block A2 is selected from the image B ( As shown by the dashed arrows in the figure), the position of image block B2 in image B is the same as the position of image block A2 in image A; then, image block B2 can be moved according to the motion vector of image block A2, such as using The motion vector (3, 3) moves the image block B2 to obtain the image block B2 'corresponding to the image block B2 (such as moving 3 pixels to the right and 3 pixels upward), and the image block B2' is the image block A2. Reference image block. Similarly, it can be determined that the reference image block of the image block A3 is the image block B3 '(as shown by the dotted arrow in the figure). Further, the template of the image block A1 may be determined according to the image blocks B2 'and B3', as shown in FIG. 2A.

In one example, the candidate image block may include M first candidate image blocks and N second candidate image blocks, where M is a natural number greater than or equal to 1, N is a natural number greater than or equal to 0, or M is greater than or A natural number equal to 0, and N is a natural number greater than or equal to 1. The first candidate image block is a candidate image block on the upper side of the current image block, and the second candidate image block is a candidate image block on the left side of the current image block. In this case, acquiring the template of the current image block according to the motion information of the candidate image block may include, but is not limited to: determining the first template according to the motion vector prediction mode and the motion information of the M first candidate image blocks; A second template is determined based on the motion vector prediction mode and motion information of each second candidate image block; then, a template for the current image block is determined based on the first template and the second module. Wherein, determining the template of the current image block based on the first template and the second template may include, but is not limited to: determining the first template as the template of the current image block; or determining the second template as the template of the current image block; or , Determine the template of the current image block after stitching the first template and the second template.

If M is a natural number greater than or equal to 1, and N is 0, a first template may be determined according to the motion vector prediction mode and motion information of the M first candidate image blocks, and the first template may be determined as a template of the current image block. If N is a natural number greater than or equal to 1, and M is 0, a second template may be determined according to the motion vector prediction mode and motion information of the N second candidate image blocks, and the second template may be determined as a template of the current image block. If M is a natural number greater than or equal to 1, and N is a natural number greater than or equal to 1, the first template may be determined according to the motion vector prediction mode and motion information of the M first candidate image blocks, and according to the N second candidate image blocks Determine the second template based on the motion vector prediction mode and motion information, and determine the template of the current image block according to the first template and the second template, which may specifically include determining the first template as the template of the current image block, or determining the second template A template of the current image block, or a template of the current image block determined after stitching the first template and the second template.

The first candidate image block includes an adjacent image block and / or a second-neighboring image block on the upper side of the current image block. The prediction mode of the adjacent image block is an inter mode or an intra mode, and the prediction mode of the next adjacent image block is an inter mode. The first candidate image block may include at least one adjacent image block whose prediction mode is inter mode, for example, all adjacent image blocks on the upper side of the current image block, or the first adjacent image block on the upper side of the current image block, Or any one or more adjacent image blocks on the upper side of the current image block. In addition, when the adjacent image blocks on the upper side of the current image block are all in the intra mode, the first candidate image block may further include at least one second neighboring image block whose prediction mode is the inter mode, for example, the upper side of the current image block All second-neighbor image blocks, or the first second-neighbor image block above the current image block, or any one or more second-neighbor image blocks above the current image block. In addition, when there are adjacent image blocks in the intra mode on the upper side of the current image block, the first candidate image block may further include adjacent image blocks in the intra mode, for example, the first intra mode on the upper side of the current image block. Adjacent image blocks of all images, adjacent image blocks of all intra-modes above the current image block, and so on. Of course, the above is only an example of the first candidate image block, which is not limited thereto.

The second candidate image block includes a neighboring image block and / or a next-neighbor image block on the left side of the current image block. The prediction mode of the adjacent image block is an inter mode or an intra mode, and the prediction mode of the next adjacent image block is an inter mode. The second candidate image block may include at least one adjacent image block whose prediction mode is inter mode, for example, all adjacent image blocks to the left of the current image block, or the first adjacent image block to the left of the current image block, Or any one or more adjacent image blocks to the left of the current image block. In addition, when the adjacent image blocks on the left side of the current image block are in the intra mode, the second candidate image block may further include at least one second-neighbor image block whose prediction mode is the inter mode, for example, the left side of the current image block All second-neighbor image blocks, or the first second-neighbor image block to the left of the current image block, or any one or more second-neighbor image blocks to the left of the current image block. In addition, when there are adjacent image blocks in the intra mode on the left side of the current image block, the second candidate image block may also include adjacent image blocks in the intra mode, for example, the first intra mode on the left side of the current image block. Adjacent image blocks of, the adjacent image blocks of all intra-modes to the left of the current image block, and so on. Of course, the above is only an example of the second candidate image block, which is not limited.

The adjacent image blocks of the current image block include, but are not limited to: spatially adjacent image blocks of the current image block (that is, adjacent image blocks in the same frame of image); or, temporal image adjacent blocks of the current image block (that is, different Adjacent image blocks in a frame image). The second-neighbor image block of the current image block includes, but is not limited to, the spatially-neighbor image block of the current image block (that is, the second-neighbor image block in the same frame image); or the time-domain next-neighbor image block of the current image block (that is, different The next-most neighboring image block in the frame image).

In one example, when M is greater than 1, the first template may include M sub-templates or P sub-templates, and is composed of M sub-templates or P sub-templates, and P may be the first candidate image block of the inter-frame mode. Quantity, P is less than or equal to M. For example, if the M first candidate image blocks are all candidate image blocks of the inter-mode, the first template may include M sub-templates and be formed by splicing the M sub-templates. For another example, if the M first candidate image blocks include P inter-mode candidate image blocks and include MP intra-mode candidate image blocks, the first template may include M sub-templates (that is, each candidate image block (Corresponding to a sub-template), and is composed of M sub-templates; or, the first template may include P sub-templates (that is, P sub-templates corresponding to P inter-mode candidate image blocks), and P sub-templates to make.

When M is equal to 1, the first template may include a first sub-template, and the first sub-template may be determined according to a motion vector prediction mode and motion information of any candidate image block on the upper side of the current image block. Wherein, since the first candidate image block includes at least one neighboring image block or a second neighboring image block whose prediction mode is the inter mode, when M is equal to 1, the first template includes the neighboring image blocks of the inter mode or The first sub-template corresponding to the next neighboring image block.

In one example, the motion information may include a motion vector and a reference frame index of the first candidate image block. Based on this, the first template is determined according to the motion vector prediction mode and motion information of the M first candidate image blocks, which may include, but not Limited to:

Case 1: For the i-th candidate image block among the M first candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an inter mode, the reference frame of the i-th candidate image block is used The index determines the reference frame image of the i-th candidate image block; according to the motion vector of the i-th candidate image block, the reference image block of the i-th candidate image block is determined from the reference frame image, and the reference image block and the i-th candidate image block The relative displacement of the candidate image block matches the motion vector of the ith candidate image block; then, according to the determined reference image block, an image block having a size of the first horizontal length and the first vertical length can be obtained as the first template. The i-th child template.

Case 2: For the i-th candidate image block among the M first candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, the i-th candidate image block is set to a default value (Such as the default pixel value, which can be a brightness value that is pre-configured based on experience) padding, based on the image blocks filled with the default values, to obtain image blocks of the first horizontal length and the first vertical length as the i-th included in the first template Child templates.

Case 3: For the i-th candidate image block among the M first candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, according to the reference frame corresponding to the i-th candidate image block The index determines the reference frame image corresponding to the i-th candidate image block; according to the motion vector corresponding to the i-th candidate image block, a reference image block corresponding to the i-th candidate image block is determined from the reference frame image, and the reference image block and The relative displacement of the i-th candidate image block matches the motion vector corresponding to the i-th candidate image block (including equal or approximately equal); according to the determined reference image block, the size of the first horizontal length and the first vertical length is obtained The image block includes the i-th sub-template included in the first template. The reference frame index and motion vector corresponding to the i-th candidate image block may be reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.

The first horizontal length and the horizontal length of the first candidate image block satisfy a first proportional relationship (such as 1: 1, 1: 2, 2: 1, etc., which is not limited), or the horizontal length of the current image block Meet the second proportional relationship (such as 1: 1, 1: 2, 2: 1, etc.), or be equal to the first preset length (configurable according to experience).

The first vertical length and the vertical length of the first candidate image block satisfy a third proportional relationship (such as 1: 1, 1: 2, 2: 1, etc.), or the vertical length of the current image block satisfies a fourth proportional relationship ( (Such as 1: 1, 1: 2, 2: 1, etc.), or equal to a second preset length (that is, a length configured according to experience).

The first proportional relationship, the second proportional relationship, the third proportional relationship, and the fourth proportional relationship may be set to be the same or different. The first preset length and the second preset length may be set to be the same or different.

In one example, when N is greater than 1, the second template may include N sub-templates or R sub-templates, and is formed by splicing N sub-templates or R sub-templates, where R may be the second candidate for the inter-frame mode. The number of image blocks, R is less than or equal to N. For example, if the N second candidate image blocks are all candidate image blocks of the inter-mode, the second template may include N sub-templates and be spliced from the N sub-templates. For another example, if the N second candidate image blocks include R inter-mode candidate image blocks and include NR intra-mode candidate image blocks, the second template may include N sub-templates (that is, each candidate image block (Corresponding to one sub-template), and is formed by splicing N sub-templates; or, the second template may include R sub-templates (that is, R sub-templates corresponding to R inter-mode candidate image blocks), and R sub-templates to make.

When N is equal to 1, the second template may include a second sub-template, and the second sub-template may be determined according to a motion vector prediction mode and motion information of any candidate image block on the left side of the current image block. Wherein, since the second candidate image block includes at least one neighboring image block or the next neighboring image block whose prediction mode is the inter mode, when N is equal to 1, the second template includes the neighboring image blocks of the inter mode or The second sub-template corresponding to the next-neighbor image block.

In one example, the motion information may include a motion vector and a reference frame index of the second candidate image block. Based on this, the second template is determined according to the motion vector prediction mode and motion information of the N second candidate image blocks, which may include but not Limited to:

Case 1: For the i-th candidate image block of the N second candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an inter mode, the reference frame of the i-th candidate image block The index determines the reference frame image of the i-th candidate image block; according to the motion vector of the i-th candidate image block, the reference image block of the i-th candidate image block is determined from the reference frame image, and the reference image block and the i-th candidate image block The relative displacement of the candidate image block matches the motion vector of the i-th candidate image block; then, according to the determined reference image block, an image block having a size of the second horizontal length and the second vertical length can be obtained as a second template including I-th child template.

Case 2: For the i-th candidate image block of the N second candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, the i-th candidate image block is set to a default value (Such as the default pixel value, which can be a brightness value pre-configured according to experience) padding, based on the image blocks filled with the default values, to obtain image blocks of the second horizontal length and the second vertical length as the i-th included in the second template Child templates.

Case 3: For the i-th candidate image block of the N second candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, according to the reference frame corresponding to the i-th candidate image block The index determines the reference frame image corresponding to the i-th candidate image block; according to the motion vector corresponding to the i-th candidate image block, a reference image block corresponding to the i-th candidate image block is determined from the reference frame image, and the reference image block and The relative displacement of the i-th candidate image block matches the motion vector corresponding to the i-th candidate image block (including equal or approximately equal); according to the determined reference image block, the size of the second horizontal length and the second vertical length is obtained The image block serves as an ith sub-template included in the second template. The reference frame index and motion vector corresponding to the i-th candidate image block may be reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.

The second horizontal length and the horizontal length of the second candidate image block satisfy a fifth proportional relationship (such as 1: 1, 1: 2, 2: 1, etc., which is not limited), or the horizontal length of the current image block Meet the sixth proportional relationship (such as 1: 1, 1: 2, 2: 1, etc.), or be equal to the third preset length (configured according to experience).

The second vertical length and the vertical length of the second candidate image block satisfy a seventh proportional relationship (such as 1: 1, 1: 2, 2: 1, etc.), or the vertical length of the current image block satisfies an eighth proportional relationship ( (Such as 1: 1, 1: 2, 2: 1, etc.), or equal to the fourth preset length (that is, a length configured according to experience).

Among them, the fifth proportional relationship, the sixth proportional relationship, the seventh proportional relationship, and the eighth proportional relationship may be set to be the same or different. The third preset length and the fourth preset length may be set to be the same or different.

In one example, acquiring a template of the current image block according to the motion information of the candidate image block may further include but is not limited to: when the current image block corresponds to multiple motion information, acquiring a template corresponding to each motion information, and For the obtaining method, refer to the foregoing embodiment; then, obtain the weight corresponding to each motion information, and obtain the template of the current image block according to the weight corresponding to each motion information and the template corresponding to the motion information. For example, based on the weight corresponding to each motion information and the template corresponding to the motion information, a template of the current image block may be obtained in a weighted average manner. The motion information corresponding to the current image block may include original motion information of the current image block.

For example, the current image block corresponds to the motion information A and the motion information B, the template TA corresponding to the motion information A is obtained by using the foregoing embodiment, and the template TB corresponding to the motion information B is obtained by using the foregoing embodiment.

Then, the weight W1 of the motion information A and the weight W2 of the motion information B can be obtained. In this way, the template of the current image block can be (TA * W1 + TB * W2) / 2.

The following describes the template of the current image block in detail in combination with several specific situations.

Case 1: The candidate image block may include adjacent image blocks of all inter-modes on the upper side of the current image block, and adjacent image blocks of all inter-modes on the left side of the current image block.

For example, referring to FIG. 2B, for the current image block A1, if there are adjacent image blocks A3 and A4 in the inter mode on the left, the image blocks A3 and A4 may be determined as the second candidate image block of the current image block A1. . Similarly, if there is an adjacent image block A2 in the inter mode on the upper side, the image block A2 may be determined as the first candidate image block of the current image block A1.

If there are no available image blocks on the left or the available image blocks on the left are in intra mode, it means that there is no candidate image block on the left side of the current image block A1. Similarly, if there are no available image blocks on the upper side or the available image blocks on the upper side are all in the intra mode, it means that there is no candidate image block on the upper side of the current image block A1. If there are no candidate image blocks on the left and upper sides, it can be explained that there is no candidate image block in the current image block A1.

If there is no candidate image block in the current image block A1, the technical solution of this embodiment is no longer adopted, but a conventional method is adopted. If the current image block A1 has candidate image blocks, such as the left candidate image block and / or the upper candidate image block, the technical solution of this embodiment is adopted.

In one example, after the candidate image blocks A2, A3, and A4 are determined, the template of the current image block A1 can be obtained according to the respective motion information of the image blocks A2, A3, and A4. For example, a reference frame image of the image block A2 may be determined according to the reference frame index, an image block B2 corresponding to the image block A2 is selected from the reference frame image, and the image block B2 is moved according to the motion vector of the image block A2 to obtain an image block. A2's reference image block B2 '. Similarly, the reference image block B3 'of the image block A3 and the reference image block B4' of the image block A4 can be obtained, as shown in FIG. 2C. Then, a template of the current image block A1 can be obtained from the reference image blocks B2 ', B3', and B4 '.

In one example, it is assumed that the horizontal length of the upper template of the current image block A1 is W and the vertical length is S. The value of W can be configured based on experience, the value of S can be configured according to experience, and the values of W and S are both No restrictions. For example, the horizontal length W of the upper template may be the horizontal length of the current image block A1, or the horizontal length of the candidate image block A2, or twice the horizontal length of the current image block A1, and the like, and the vertical length S of the upper template It may be the vertical length of the candidate image block A2, or 1/3 of the vertical length of the candidate image block A2, or the like. Referring to FIG. 2D, taking a template corresponding to the reference image block B2 'as an example, the horizontal length W of the template is the horizontal length of the candidate image block A2, that is, the horizontal length of the reference image block B2'; the vertical length S of the template It is 1/3 of the vertical length of the candidate image block A2, that is, 1/3 of the vertical length of the reference image block B2 '.

It is assumed that the horizontal length of the template on the left side of the current image block A1 is R and the vertical length is H. The value of R can be configured based on experience, and the value of H can be configured based on experience. There are no restrictions on the values of R and H. For example, the vertical length H of the left template may be the vertical length of the current image block A1 or the vertical length of the candidate image block A3, and the horizontal length R of the left template may be the horizontal length of the candidate image block A3 or the candidate image. The lateral length of the block A3 is 1/3 and so on. Referring to FIG. 2D, taking a template corresponding to the reference image block B3 'as an example, the vertical length H of the template is the vertical length of the candidate image block A3, and the horizontal length R of the template is 1 / of the horizontal length of the candidate image block A3. 3.

Similarly, the template corresponding to the reference image block B4 'can also be shown in FIG. 2D.

In one example, assuming that there are M candidate image blocks on the upper side of the current image block, the horizontal length of the i-th candidate image block is w _i , and the vertical length is S, then the prediction mode of the candidate image block is determined.

If it is in the intra mode, the corresponding sub-template is no longer generated; or, it is filled according to the default value (such as the default pixel value, which can be a brightness value pre-configured according to experience), as the i-th sub-template on the upper side.

If it is in the inter mode, the motion information (such as a motion vector and a reference frame index) of the i-th candidate image block is obtained, and a template with a horizontal length w _i and a vertical length S is generated based on the motion vector and the reference frame index. , As the i-th sub-template on the upper side. Specifically, if the motion vector is MV and the reference frame index is idx, a rectangular block with a relative displacement of MV and a horizontal length of w _i and a vertical length of S is found in the idx reference image of the current frame as the upper side. i child templates.

Suppose the current left image block has N candidate image block, the longitudinal length of the i-th candidate image blocks as H _i, the lateral length is R, the determined prediction mode candidate image block.

If it is in the intra mode, the corresponding sub-template is no longer generated; or, it is filled according to the default value (such as the default pixel value, which can be a brightness value pre-configured according to experience), as the i-th sub-template on the left.

If the inter mode, the motion information is acquired i-th candidate image blocks (e.g., motion vector and reference frame index, etc.), to generate a transverse length R based on the motion vector and the reference frame index, the longitudinal length of template h _i As the i-th sub-template on the left. Specifically, if the motion vector is MV, the reference frame index idx, find the relative displacement of the lateral length of the MV R, a longitudinal length of a rectangular block of idx h _i in the reference image of the current frame, a second left-side i child templates.

Further, the upper template can be stitched from all the sub templates on the upper side, the left template can be stitched from all the sub templates on the left, and the upper template and the left template are stitched into the template of the current image block.

Case 2: The candidate image block may include a neighboring image block of the first inter mode on the upper side of the current image block, and a neighboring image block of the first inter mode on the left of the current image block.

For example, referring to FIG. 2E, for the current image block A1, if the first image block A3 on the left side is in an inter mode, the image block A3 may be determined as a candidate image block of the current image block A1. If the first image block A2 on the upper side is in an inter mode, the image block A2 may be determined as a candidate image block of the current image block A1.

If there are no image blocks available on the left, or the first image block on the left is in intra mode, there are no candidate image blocks on the left side of the current image block A1. If there are no image blocks available on the upper side, or if the first image block on the upper side is in intra mode, then there is no candidate image block on the upper side of the current image block A1. If there are no candidate image blocks on the left and upper sides, the current image block A1 has no candidate image blocks.

Further, if there is no candidate image block in the current image block A1, the technical solution of this embodiment is no longer adopted, but a conventional method is adopted. If the current image block A1 has candidate image blocks, such as the left candidate image block and / or the upper candidate image block, the technical solution of this embodiment is adopted.

After the candidate image blocks A2 and A3 are determined, a template of the current image block A1 can be obtained according to the respective motion information of the image blocks A2 and A3. For example, the reference frame image of the image block A2 can be determined according to the reference frame index, the image block B2 corresponding to the image block A2 is selected from the reference frame image, and the image block B2 is moved according to the motion vector of the image block A2 to obtain the image block A2 Reference picture block B2 '. Similarly, a reference image block B3 'of the image block A3 can be obtained. In this regard, a template of the current image block A1 can be obtained from the reference image block B2 'and the reference image block B3'.

In one example, it is assumed that the horizontal length of the upper template of the current image block A1 is W and the vertical length is S. The value of W can be configured based on experience, the value of S can be configured according to experience, and the values of W and S are both No restrictions. For example, the horizontal length W of the upper template may be the horizontal length of the current image block A1 or the horizontal length of the candidate image block A2, and the vertical length S of the upper template may be the vertical length of the candidate image block A2 or the candidate image. The length A3 of the block A2 is equal to 1/3. Referring to FIG. 2F, it is a schematic diagram of a template corresponding to the reference image block B2 '.

It is assumed that the horizontal length of the template on the left side of the current image block A1 is R and the vertical length is H. The value of R can be configured based on experience, and the value of H can be configured based on experience. There are no restrictions on the values of R and H. For example, the vertical length H of the left template can be the vertical length of the current image block A1 or the vertical length of the candidate image block A3, and the horizontal length R of the left template can be the horizontal length of the candidate image block A3 or a candidate. The horizontal length of the image block A3 is 1/3 and so on. Based on this, referring to FIG. 2F, it is a schematic diagram of a template corresponding to the reference image block B3 '.

In one example, assuming that there are M candidate image blocks on the upper side of the current image block, and the horizontal length of the first candidate image block is w and the vertical length is S, the prediction mode of the candidate image block is determined. If it is in the intra mode, the corresponding template is no longer generated; or, it is filled according to the default value (such as the default pixel value, which may be a brightness value pre-configured according to experience), and is used as the corresponding upper template. If it is in the inter mode, the motion information (such as the motion vector and the reference frame index) of the candidate image block is obtained, and a template with a horizontal length of w and a vertical length of S is generated based on the motion vector and the reference frame index, as the corresponding upper Side template.

Assuming that there are N candidate image blocks on the left side of the current image block, and the vertical length of the first candidate image block is h and the horizontal length is R, the prediction mode of the candidate image block is determined. If it is in the intra mode, the corresponding template is no longer generated; or it is filled according to the default value and used as the corresponding left template. If it is in the inter mode, obtain the motion information (such as the motion vector and reference frame index) of the candidate image block, and generate a template with a horizontal length R and a vertical length h based on the motion vector and the reference frame index, as the corresponding left template .

Case 3: The candidate image block may include a neighboring image block of the first inter mode on the upper side of the current picture block, and a neighboring image block of the first inter mode on the left of the current picture block.

Compared with FIG. 2F in the second case, in the third case, as shown in FIG. 2G, the horizontal length W of the upper template of the current image block A1 is taken as the horizontal length of the current image block A1, and The vertical length H is taken as the vertical length of the current image block A1, and other processes are similar to the second case.

Case 4: The candidate image block may include the adjacent image block in the inter mode on the upper side of the current image block, and the next adjacent image block in the inter mode on the upper side of the current image block (that is, when the adjacent image block is in the intra mode, select The adjacent image block corresponds to the current image block that is the second-neighboring image block), the adjacent image block in the inter mode on the left side of the current image block, and the second-neighbor image block in the inter-frame mode on the left side of the current image block.

For example, referring to FIG. 2H, for the current image block A1, there are adjacent image blocks A3 and A4 in the inter mode on the left side, then the image blocks A3 and A4 in the inter mode can be determined as candidate images of the current image block A1. Piece. Similarly, if there is an adjacent image block A2 in the inter mode on the upper side, the image block A2 in the inter mode can be determined as a candidate image block of the current image block A1.

In addition, there is an adjacent image block A7 in the intra mode on the left side, and there is an image block A8 in the inter mode on the left side of the image block A7, that is, the image block A8 is the next-to-adjacent image block on the left of the current image block A1. The next neighboring image block A8 in the inter mode is determined as a candidate image block of the current image block A1.

Similarly, there is an adjacent image block A5 in the intra mode on the upper side, and there is an image block A6 in the inter mode on the upper side of the image block A5, that is, the image block A6 is a second-neighbor image block on the upper side of the current image block A1. Therefore, The next neighboring image block A6 in the inter mode may be determined as a candidate image block of the current image block A1.

After determining that the candidate image blocks are image blocks A2, A3, A4, A6, and A8, according to the respective motion information of the image blocks A2, A3, A4, A6, and A8, a template of the current image block A1 is obtained. For details, please refer to the situation First, it is more to obtain sub-templates according to the respective motion information of image blocks A6 and A8. The template is finally shown in FIG. 2I.

Case 5: If the first adjacent image block above the current image block is in intra mode and the image block above the first adjacent image block is in inter mode, the candidate image block may include the current image block The next neighboring image block in the inter mode. In addition, if the first adjacent image block to the left of the current image block is in intra mode and the image block to the left of the first adjacent image block is in inter mode, the candidate image block may include the current image block left The next neighboring image block of the inter-frame mode.

For example, referring to FIG. 2K, for the current image block A1, if the first image block A2 on the upper side is in the intra mode, and the image block A4 in the inter mode exists on the upper side of the image block A2, that is, the image block A4 is the current The second-neighboring image block on the upper side of the image block A1, therefore, the second-neighboring image block A4 in the inter mode can be determined as a candidate image block of the current image block A1.

In addition, if the first image block A3 on the left side is in the intra mode, and there is an image block A5 on the left side of the image block A3 in the inter mode, that is, the image block A5 is the next-neighbor image block on the left of the current image block A1, so , The next neighboring image block A5 in the inter mode may be determined as a candidate image block of the current image block A1.

After the candidate image blocks A4 and A5 are determined, a template of the current image block A1 can be obtained according to the respective motion information of the image blocks A4 and A5. For specific acquisition methods, refer to Cases 2 and 3. For the template, see Figure 2L or Figure 2M. Show.

Case 6: The candidate image block may include an adjacent image block in an inter mode on the upper side of the current image block, an adjacent image block in an intra mode on the upper side of the current image block, and an adjacent inter mode in the left side of the current image block. Image block, adjacent image block in intra mode to the left of the current image block.

There is an adjacent image block A7 in the intra mode on the left side, and the image block A7 in the intra mode can be determined as a candidate image block of the current image block A1. There is an adjacent image block A5 in the intra mode on the upper side, and the image block A5 in the intra mode can be determined as a candidate image block of the current image block A1.

After determining the candidate image blocks A2, A3, A4, A5, and A7, according to the respective motion information of the image blocks A2, A3, A4, A5, and A7, a template of the current image block A1 is obtained. For the specific acquisition method, see Case 1, except A template is obtained according to the respective motion information of the image blocks A5 and A7. The template is finally shown in FIG. 2J.

When obtaining a template based on the motion information of the image block A5, since the image block A5 is an intra mode and does not have motion information, the motion information of the adjacent image block A6 of the image block A5 can be determined as the motion information of the image block A5. After obtaining the motion information of the image block A5, the corresponding sub-template can be obtained by using the motion information of the image block A5. For the specific acquisition method, refer to Case 1.

Similarly, when obtaining a template based on the motion information of the image block A7, since the image block A7 is an intra mode and does not have motion information, the motion information of the adjacent image block A8 of the image block A7 can be determined as the image block A7. Motion information, and use the motion information of image block A7 to obtain the corresponding template.

Case 7: If the first adjacent image block above the current image block is in intra mode and the image block above the first adjacent image block is in inter mode, the candidate image block may include the current image block Adjacent image blocks of the first intra mode on the upper side. In addition, if the first adjacent image block to the left of the current image block is in intra mode and the image block to the left of the first adjacent image block is in inter mode, the candidate image block may include the current image block left Adjacent image blocks of the first intra mode on the side.

For example, referring to FIG. 2K, for the current image block A1, if the first image block A2 on the upper side is in the intra mode, even if the image block A4 in the inter mode exists on the upper side of the image block A2, the The image block A2 is determined as a candidate image block of the current image block A1. If the first image block A3 on the left side is in the intra mode, even if an image block A5 in the inter mode exists on the left side of the image block A3, the image block A3 in the intra mode can be determined as a candidate image block of the current image block A1.

After the candidate image blocks A2 and A3 are determined, a template of the current image block A1 can be obtained according to the respective motion information of the image blocks A2 and A3. For specific acquisition methods, refer to Cases 2 and 3. For the template, see Figure 2N or Figure 2O. Show.

When obtaining a template based on the motion information of the image block A2, since the image block A2 is an intra mode and does not have motion information, the motion information of the adjacent image block A4 of the image block A2 can be determined as the motion corresponding to the image block A2 Information, and use the motion information corresponding to the image block A2 to obtain the corresponding template. When obtaining a template based on the motion information of image block A3, since image block A3 is in the intra mode and does not have motion information, the motion information of the adjacent image block A5 of image block A3 can be determined as the motion information corresponding to image block A3. And use the motion information corresponding to the image block A3 to obtain the corresponding template.

Example three:

In the inter-frame coding technology, a motion vector may be used to represent a relative displacement between a current image block in a current frame image and a reference image block in a reference frame image. For example, image A is the current frame image, image block A1 is the current image block, image B is the reference frame image of image A, and image block B1 is the reference image block of image block A1. Because there is a strong time-domain correlation between image A and image B, when image block A1 of image A needs to be transmitted, a motion search can be performed in image B to find image block B1 that best matches image block A1 and determine the image The relative displacement between the block A1 and the image block B1, and the relative displacement is also the motion vector of the image block A1.

For example, the motion vector is (-6, 4), which indicates that the image block B1 moves 6 pixels to the left in the horizontal direction and 4 pixels upwards in the vertical direction compared to the image block A1.

When the encoding end sends the encoded bit stream corresponding to the image block A1 to the decoding end, the encoded bit stream carries the motion vector (-6, 4) of the image block A1, instead of the reconstruction information and / or prediction information of the image block A1. After receiving the encoded bit stream of image block A1, the decoder can obtain the motion vector (-6, 4) of image block A1. Based on the current position and motion vector (-6, 4) of image block A1, the reference frame image B To determine the position of the reference image block B1, that is, to move 6 pixels to the left and 4 pixels upward at the position of the current image block A1, the position of the reference image block B1 is obtained. The position reads the reference image block B1, and reconstructs the image block A1 by using the reference image block B1. Because the similarity between the reference image block B1 and the current image block A1 is very high, using the reference image block B1 to reconstruct the current image block A1 can reconstruct a highly similar image. Since the number of bits occupied by the motion vector is less than the number of bits occupied by the reconstruction information and / or prediction information of the image block A1, the motion vector is carried in the encoded bit stream corresponding to the current image block A1 instead of the reconstruction information of the image block A1. And / or prediction information, thereby saving a lot of bits.

If the current frame image A includes a large number of image blocks, the motion vector of each image block also occupies more bits. Therefore, in order to further save the number of bits, the motion vector of the adjacent image block can also be used to determine the current image block A1. Motion vector. For example, in the current frame image A, the image block adjacent to the current image block A1 may include image blocks A2 and A3, and the motion vector list of the current image block A1 may include the motion vector A21 and image block A3 of the image block A2 Motion vector A31.

When the encoding end sends the encoded bit stream corresponding to the image block A1 to the decoding end, the encoded bit stream carries the index value of the original motion vector (for example, the index value of the motion vector A21 in the motion vector list) instead of the image block A1 The motion vector (-6, 4) is not the reconstruction information and / or prediction information of the image block A1. After receiving the encoded bit stream of the image block A1, the decoding end can obtain the index value of the original motion vector, and obtain the original motion vector A21 from the motion vector list according to the index value. Since the number of bits occupied by the index value is less than the number of bits occupied by the motion vector, further bits can be saved.

In this embodiment, instead of directly using the original motion vector A21 as the final motion vector of the image block A1, a target motion vector different from the original motion vector A21 is obtained according to the original motion vector A21, and the target motion vector is used as the image block A1. Final motion vector. Obviously, since the target motion vector is the closest to the motion vector of the image block A1, compared with the method of “using the original motion vector A21 as the final motion vector of the image block A1 directly”, the above “taking the target motion vector as The method of "final motion vector of image block A1" can solve problems such as low prediction quality and prediction error.

In this embodiment, the original mode information is the original motion vector of the current image block, and the target mode information is the target motion vector of the current image block. The encoding end can obtain the original motion vector of the current image block, and according to the original motion vector and the obtained The template obtains the target motion vector of the current image block, which is different from the original motion vector. The current image block is encoded according to the target motion vector to obtain an encoded bit stream corresponding to the current image block. The encoder can send the encoded bit stream to the decoder.

In an example, the encoding end may first obtain the original motion vector of the current image block. Assuming that the motion vector list of the current image block A1 at the encoding end includes motion vectors A21, A31, A41, and A51 in turn, then select a motion from the motion vector list. The vector serves as the original motion vector of the image block A1. Of course, the above manner is only an example, and there is no limitation on this. For example, the default motion vector may be directly determined as the original motion vector.

The encoding end selects a motion vector from the motion vector list, which may include: the encoding end selects the first motion vector from the motion vector list; or, selects the last motion vector from the motion vector list; or, selects the motion vector from the motion vector list. A motion vector is randomly selected in the method; or a motion vector is selected from the motion vector list using a hash algorithm. Of course, the above method is only a few examples, and there is no limitation on this, as long as the motion vector can be selected from the motion vector list.

The motion vector list is used to record a motion vector of an image block adjacent to the current image block. For example, after obtaining the motion vector A21 of the image block A2, the motion vector A21 may be recorded in the motion vector list, and after obtaining the motion vector A31 of the image block A3, the motion vector A31 may be recorded in the motion vector list, so as to By analogy, the motion vector list of the image block A1 can finally be obtained.

In an example, the process of the coding end obtaining the target motion vector according to the original motion vector and the obtained template can be referred to the following fourth and fifth embodiments. For example, assuming that the motion vector A21 is determined as the original motion vector, the original motion vector A21 can be used to obtain the target motion vector of the image block A1, and the target motion vector can be used as the final motion vector of the image block A1.

In an example, the process of encoding the current image block according to the target motion vector to obtain the encoded bit stream corresponding to the current image block and sending the encoded bit stream to the decoding end may include: after obtaining the target motion vector, The current image block can be encoded by using the target motion vector, and there is no limitation on this encoding method. After encoding is completed, an encoded bit stream corresponding to the current image block can be obtained, and the encoded bit stream is sent to the decoding end.

The encoding end may send an encoded bit stream to the decoding end according to the original motion vector and the target motion vector. Specifically, the encoding performance of the original motion vector and the encoding performance of the target motion vector can be obtained. For example, when the encoding performance of the target motion vector is better than the encoding performance of the original motion vector, the encoded bit stream sent to the decoding end carries the first indication information. When the encoding performance of the original motion vector is better than the encoding performance of the target motion vector, the encoded bit stream sent to the decoding end carries the second indication information.

For the process of obtaining the encoding performance of the original motion vector and the encoding performance of the target motion vector by the encoding end, refer to the subsequent embodiments.

The above method is to notify the first instruction information or the second instruction information explicitly. In practical applications, the notification may also be performed implicitly, that is, the first instruction information or the second instruction information is not carried in the encoded bit stream corresponding to the current image block. Instructions. Specifically, the encoding end and the decoding end may also negotiate a decision strategy or define a decision strategy in a standard, and store the decision strategies at the encoding end and the decoding end, respectively. For example, the decision strategy may agree on the first strategy information, or agree on the second strategy information, or agree on the third strategy information. The third policy information is the same policy information as the candidate image block of the current image block.

When the decision strategy agrees with the first strategy information and the encoding performance of the target motion vector is better than the encoding performance of the original motion vector, the encoded bitstream corresponding to the current image block may not carry the first indication information and the second indication information. When the decision strategy stipulates the second instruction information and the encoding performance of the original motion vector is better than the encoding performance of the target motion vector, the encoded bit stream corresponding to the current image block may not carry the first instruction information and the second instruction information. When the decision strategy agrees on the third strategy information, and the candidate image block adopts the first strategy information, and the coding performance of the target motion vector is better than the coding performance of the original motion vector, the coding bit stream corresponding to the current image block may not carry the first indication. Information and second instruction information. When the decision strategy agrees with the third strategy information, and the candidate image block uses the second strategy information, and the coding performance of the original motion vector is better than the coding performance of the target motion vector, the coding bitstream corresponding to the current image block may not carry the first indication. Information and second instruction information.

In an example, the encoding end sends the encoded bit stream to the decoding end according to the original motion vector and the target motion vector, and may further include: obtaining an index value of the original motion vector in the motion vector list; corresponding to the current image block sent to the decoding end The indexed value is carried in the encoded bitstream of. For example, if the original motion vector is motion vector A21 and motion vector A21 is the first motion vector in the motion vector list, the index value may be 1.

As can be seen from the above, the target motion vector can be obtained based on the original motion vector and the final motion vector of the current image block can be determined based on the target motion vector, instead of directly determining the final motion vector of the current image block based on the original motion vector, thereby effectively improving the motion vector. Accuracy, which in turn improves encoding performance. Moreover, when acquiring the target motion vector according to the original motion vector, it is possible to: acquire a template of the current image block according to the motion information of the candidate image block, and acquire the target motion vector of the current image block according to the template of the current image block. The above method can quickly obtain the template of the current image block, and then obtain the target motion vector of the current image block according to the template, thereby effectively improving the encoding and decoding efficiency and reducing the encoding and decoding delay. For example, before the reconstruction phase, a template of the current image block can be obtained, and a target motion vector of the current image block can be obtained according to the template of the current image block.

Embodiment 4:

Based on the third embodiment, the process of the encoder obtaining the target motion vector according to the original motion vector and the obtained template can be seen in FIG. 3A. The process may include:

Step 311: The encoding end determines the original motion vector as a central motion vector.

Step 312: The encoding end determines an edge motion vector corresponding to the central motion vector. The edge motion vector may be different from the center motion vector.

Determining the edge motion vector corresponding to the central motion vector may include: moving the central motion vector (x, y) by an offset St in different directions to obtain edge motion vectors (x-St, y) in different directions, ( x + St, y), (x, y + St), (x, y-St). For example, in the horizontal direction, the center motion vector (x, y) can be shifted to the left by an offset St to obtain an edge motion vector (x-St, y), and the center motion vector (x, y) can be shifted to the right by an offset Get the edge motion vector (x + St, y) by St; in the vertical direction, you can move the center motion vector (x, y) up by the offset St to get the edge motion vector (x, y + St) and move the center The vector (x, y) is moved downward by the offset St to obtain the edge motion vector (x, y-St).

The initial value of the offset St can be configured according to experience, for example, it can be 2, 4, 8, 16, and so on.

Assuming that the center motion vector is (3, 3) and the offset St is 4, the edge motion vectors (7, 3), (3, 7), (-1, 3), and (3, -1) are obtained.

Step 313: The encoder obtains the encoding performance of the central motion vector according to the template of the current image block, and obtains the encoding performance of the edge motion vector according to the template of the current image block.

Case 1: The encoding end obtains the encoding performance of the central motion vector according to the template of the current image block, which may include, but is not limited to, determining the encoding of the central motion vector according to the parameter information of the template of the current image block and the parameter information of the first target reference block. performance. The first target reference block may be an image block obtained after the reference image block corresponding to the template is offset based on the central motion vector. Specifically, the encoding end may determine the prediction performance of the central motion vector according to the parameter information of the template and the parameter information of the first target reference block, and determine the encoding performance of the central motion vector according to the prediction performance of the central motion vector. For example, the encoding performance of the central motion vector may be determined based on the prediction performance and the actual number of bits required for encoding.

The above parameter information may be a brightness value, or a brightness value and a chrominance value.

Assuming that the parameter information is a brightness value, in order to determine the coding performance of the central motion vector, the brightness value of the template of the current image block and the brightness value of the first target reference block may be obtained first. After obtaining the template of the current image block, the brightness value of each pixel of the template can be obtained, and the reference image block corresponding to the template can be obtained. For example, if the central motion vector is (3, 3), the reference image block can be moved by using the central motion vector (3, 3) to obtain the image block X corresponding to the reference image block (for example, the reference image block is moved to the right by 3 3 pixels, move up 3 pixels, and mark the processed image block as image block X), and the image block X is the first target reference block, and the brightness value of each pixel point of the image block X can be obtained.

Based on the brightness value of each pixel of the template and the brightness value of each pixel of the image block X, the prediction performance of the central motion vector can be determined using the following formula:

SAD is the sum of available absolute differences used to represent the prediction performance of the central motion vector. TM _i represents the brightness value of the i-th pixel of the template, TMP _i represents the brightness value of the i-th pixel of the image block X, and M represents the total number of pixels.

Assuming that the parameter information is a luminance value and a chrominance value, the following formula is used to determine the brightness value prediction performance SAD of the central motion vector,

The following formula is used to determine the chromaticity value prediction performance CSAD of the central motion vector:

The average of the luma value prediction performance SAD and the chroma value prediction performance CSAD is the prediction performance of the center motion vector. Among them, CSAD is the sum of the available absolute differences, which is used to represent the chrominance value prediction performance of the central motion vector, CTM _i represents the chrominance value of the i-th pixel point of the template, and CTMP _i represents the chrominance of the i-th pixel point of the image block X Value, M _c represents the total number of pixels.

Further, after obtaining the prediction performance of the center motion vector, the encoding performance of the center motion vector may be determined according to the prediction performance and the actual number of bits required for encoding. For example, RDO (Rate Distortion Optimized, Rate-Distortion Principle) can be used to determine the coding performance of the central motion vector, and RDO usually uses the following formula to determine the coding performance of the central motion vector:

J = D + λ * R.

Among them, J represents encoding performance, D represents prediction performance, λ is a Lagrangian multiplier, which is a numerical value configured according to experience, and R is an actual number of bits required for image block encoding, that is, a sum of bits of information carried by an encoded bit stream.

In the second case, the encoding end obtains the encoding performance of the edge motion vector according to the template of the current image block, which may include but is not limited to: determining the encoding of the edge motion vector according to the parameter information of the template of the current image block and the parameter information of the second target reference block performance. The second target reference block may be an image block obtained after the reference image block corresponding to the template is offset based on the edge motion vector. Specifically, the encoding end may determine the prediction performance of the edge motion vector according to the parameter information of the template and the parameter information of the second target reference block, and determine the encoding performance of the center motion vector according to the prediction performance of the edge motion vector. For example, the encoding performance of the edge motion vector may be determined based on the prediction performance and the actual number of bits required for encoding.

Case 2 is similar to Case 1, except that in Case 2, the reference image block of the template is moved using the edge motion vector to obtain the second target reference block, and the encoding performance of the edge motion vector is obtained using the second target reference block. In one, the reference image block of the template is moved using the central motion vector to obtain a first target reference block, and the coding performance of the central motion vector is obtained using the first target reference block.

Step 314: The encoding end determines a target motion vector from the center motion vector and the edge motion vector according to the coding performance of the center motion vector and the respective coding performance of the edge motion vector.

Specifically, the coding end may select a motion vector with the best coding performance from the center motion vector and the edge motion vector. When the motion vector with the best coding performance is not the original motion vector, the motion vector with the best coding performance can be determined as the target motion vector. When the motion vector with the best coding performance is the original motion vector, a motion vector with the second best coding performance can be selected from the center motion vector and the edge motion vector as the target motion vector.

For example, if the motion vector with the best encoding performance is the edge motion vector (7, 3), the encoding end may determine the edge motion vector (7, 3) as the target motion vector. If the motion vector with the best encoding performance is the center motion vector as (3, 3), that is, the original motion vector, the encoding end can also use the edge motion vector (such as edge motion vector (7, 3), etc.) with the best encoding performance. ) Is determined as the target motion vector.

Embodiment 5:

Based on the third embodiment, the process of the encoder obtaining the target motion vector according to the original motion vector and the obtained template can be seen in FIG. 3B. The process may include:

Step 321: The encoding end determines the original motion vector as a central motion vector.

Step 322: The encoding end determines an edge motion vector corresponding to the central motion vector. The edge motion vector may be different from the center motion vector.

Step 323: The encoder obtains the encoding performance of the central motion vector according to the template of the current image block, and obtains the encoding performance of the edge motion vector according to the template of the current image block.

Step 324: The encoder determines whether the iteration end condition of the target motion vector is satisfied. If yes, go to step 326; if no, go to step 325.

The iteration end condition may include, but is not limited to, the number of iterations reaching the number threshold, or the execution time reaching the time threshold, or the offset parameter St has been modified to a preset value, such as 1.

Of course, the above are just a few examples of iteration end conditions, and there are no restrictions on this iteration end condition.

In step 325, the encoder selects a motion vector with the best coding performance from the center motion vector and the edge motion vector as a new center motion vector, and returns to step 322.

For example, if the motion vector with the best coding performance is the edge motion vector (7, 3), the edge motion vector (7, 3) may be determined as the new central motion vector, and step 322 is performed again, and so on.

When step 322 is performed for the first time, the value of the offset parameter St may be an initial value, such as 16. When step 322 is performed again, the value of the offset parameter St is adjusted first, for example, adjusted to the last offset parameter St minus 2, or adjusted to half of the last offset parameter St. This article does not limit this, as long as the adjusted offset parameter St is smaller than the last offset parameter St, and subsequent adjustments are made to half of the last offset parameter St as an example. Therefore, when step 322 is performed a second time, the value of the offset parameter St is 8; when step 322 is performed a third time, the value of the offset parameter St is 4; and so on.

After adjusting the value of the offset parameter St, first determine whether the adjusted offset parameter St is less than or equal to a preset value, such as 1. If not, step 322 may be performed based on the adjusted offset parameter St. If so, the value of the offset parameter St can be set to 1, and step 322 is performed based on the offset parameter St (that is, the value 1), and when the execution proceeds to step 324, the judgment result is that the end of the iteration is satisfied condition.

Step 326: The encoding end determines the target motion vector from the center motion vector and the edge motion vector according to the encoding performance of the center motion vector and the encoding performance of the edge motion vector.

Embodiment 6:

Based on the third embodiment, the encoding end can obtain the encoding performance of the original motion vector and the encoding performance of the target motion vector. The encoding end obtaining the encoding performance of the original motion vector may include: determining the encoding performance of the original motion vector according to the parameter information of the template of the current image block and the parameter information of the third target reference block. The third target reference block is an image block obtained after the reference image block corresponding to the template is offset based on the original motion vector. Specifically, the prediction performance of the original motion vector may be determined according to the parameter information of the template and the parameter information of the third target reference block, and the encoding performance of the original motion vector may be determined according to the prediction performance. For example, the encoding performance of the original motion vector is determined based on the prediction performance and the actual number of bits required for encoding. The above parameter information may be a brightness value, or a brightness value and a chrominance value.

The encoding end acquiring the encoding performance of the target motion vector may include, but is not limited to, determining the encoding performance of the target motion vector according to the parameter information of the template of the current image block and the parameter information of the fourth target reference block. The fourth target reference block is an image block obtained after the reference image block corresponding to the template is offset based on the target motion vector. Specifically, the prediction performance of the target motion vector may be determined according to the parameter information of the template and the parameter information of the fourth target reference block, and the encoding performance of the target motion vector may be determined according to the prediction performance. For example, based on the predictive performance and the actual number of bits required for encoding, the encoding performance of the target motion vector is determined. The above parameter information may be a brightness value, or a brightness value and a chrominance value.

The above process is similar to the fourth embodiment, except that when the third target reference block or the fourth target reference block is obtained, the reference image block corresponding to the template is moved based on the original motion vector or the target motion vector, rather than as in the third embodiment. The reference image block corresponding to the template is moved based on the center motion vector.

Embodiment 7:

In this embodiment, the original mode information is the original motion vector and the original reference frame of the current image block, and the target mode information is the target motion vector and the target reference frame of the current image block. Based on this, the encoder can obtain the original motion vector and the original reference frame of the current image block, and obtain the target motion vector (which can be different from the original motion vector) and the target reference according to the original motion vector, the original reference frame, and the obtained template. frame. Then, the current image block may be encoded according to the target motion vector and the target reference frame to obtain an encoded bit stream corresponding to the current image block, and the encoded bit stream is sent to the decoding end.

In an example, the process of obtaining the original reference frame of the current image block by the encoder. For the current image block, there can be one or more reference frames (video frames with strong time-domain correlation), and one of them can be The reference frame is used as the original reference frame, and the remaining reference frames are candidate reference frames. In this embodiment, a target reference frame needs to be selected from the original reference frame and all candidate reference frames, and the target reference frame is the final reference frame of the current image block, and the target reference frame is used for subsequent processing.

In an example, the process for the encoder to obtain the target motion vector and the target reference frame according to the original motion vector, the original reference frame, and the obtained template can refer to the subsequent embodiments. For example, if the motion vector A21 is determined as the original motion vector, the reference frame 1 is determined as the original reference frame, and the reference frame 2 and the reference frame 3 are determined as candidate reference frames, the original motion vector A21, the reference frame 1, and the reference frame 2 are used. And reference frame 3 to obtain a target motion vector and a target reference frame. The target motion vector may be used as the final motion vector of the current image block. The target reference frame may be a reference frame in reference frame 1, reference frame 2, and reference frame 3. The target reference frame is used as the final reference of the current image block. frame.

In an example, the process of encoding the current image block according to the target motion vector and the target reference frame to obtain an encoded bit stream corresponding to the current image block and sending the encoded bit stream to the decoding end may include, but is not limited to: After the encoder obtains the target motion vector and the target reference frame, it can use the target motion vector and the target reference frame to encode the current image block, and there is no limitation on this encoding method. After the encoding is completed, the encoding end can obtain the encoded bit stream corresponding to the current image block, and sends the encoded bit stream to the decoding end.

The encoding end may send an encoded bit stream to the decoding end according to the original motion vector and the target motion vector. Specifically, the encoding performance of the original motion vector and the encoding performance of the target motion vector can be obtained. When the encoding performance of the target motion vector is better than the encoding performance of the original motion vector, the encoded bit stream corresponding to the current image block sent to the decoding end carries the first indication information. When the encoding performance of the original motion vector is better than the encoding performance of the target motion vector, the encoded bit stream corresponding to the current image block sent to the decoding end carries the second indication information.

For the process of obtaining the encoding performance of the original motion vector and the encoding performance of the target motion vector by the encoding end, refer to the foregoing sixth embodiment.

The above method is to notify the first instruction information or the second instruction information explicitly. In practical applications, the first instruction information or the second instruction information may also be notified implicitly, that is, the encoded bit stream corresponding to the current image block is not included. The first instruction information or the second instruction information is carried. Specifically, the encoding end and the decoding end may also negotiate a decision strategy or define a decision strategy in a standard, and store the decision strategy on the encoding end and the decoding end respectively. For example, the decision strategy may agree on the first policy information or agree on the second policy information. Strategy information, or contracted third strategy information. The third policy information is the same policy information as the candidate image block of the current image block. Then, it can be determined based on the decision strategy in which case the first indication information or the second indication information may not be carried in the encoded bit stream corresponding to the current image block. For detailed processing, refer to the third embodiment.

It can be seen from the above that the target motion vector and the target reference frame can be obtained according to the original motion vector and the original reference frame, and the final motion vector of the current image block is determined according to the target motion vector, and the final reference frame of the current image block is determined according to the target reference frame. Instead of directly determining the original motion vector as the final motion vector of the current image block, the original reference frame is used to determine the final reference frame of the current image block, which can effectively improve the accuracy of the motion vector and improve coding performance. In addition, since the template of the current image block can be quickly obtained according to the motion information of the candidate image block, the codec efficiency can be effectively improved and the codec delay can be reduced. For example, the template of the current image block can be obtained before the reconstruction phase.

Embodiment 8:

Based on the seventh embodiment, the encoder obtains the target motion vector and the target reference frame according to the original motion vector, the original reference frame, and the template. The implementation process can be shown in FIG. 3C.

Step 331: The encoder obtains a candidate motion vector of the original reference frame based on the template of the current image block and the original motion vector. The candidate motion vector may be different from the original motion vector.

In an example, the encoding end obtains candidate motion vectors of the original reference frame based on the template of the current image block and the original motion vector, which may include, but is not limited to, the encoding end determines the original motion vector as the center motion vector, and determines the center motion vector. Corresponding edge motion vector, the edge motion vector is different from the center motion vector; the encoding end obtains the encoding performance of the center motion vector according to the template of the current image block, and obtains the encoding performance of each edge motion vector according to the template of the current image block; then, encoding The end may determine the candidate motion vector of the original reference frame from the center motion vector and the edge motion vector according to the coding performance of the center motion vector and the coding performance of each edge motion vector.

For the process of obtaining the candidate motion vector of the original reference frame by the encoding end according to the original motion vector, refer to the fourth or fifth embodiment, and only replace the target motion vector in the fourth or fifth embodiment with the original reference frame. Candidate motion vectors are sufficient.

Step 332: The encoder obtains the initial motion vector of each candidate reference frame according to the original motion vector.

In one example, the encoder obtains the initial motion vector of the candidate reference frame according to the original motion vector, which may include: according to the distance between the frame where the current image block is located and the original reference frame (such as the frame between the frame where the current image block is located and the original reference frame). Number), the distance between the frame where the current image block is located and the candidate reference frame, and the original motion vector to obtain the initial motion vector of the candidate reference frame.

For example, suppose the original motion vector is motion vector 1, the original reference frame is reference frame 1, the candidate reference frame is reference frame 2 and reference frame 3, and the distance between the frame where the current image block is located (hereinafter referred to as the current frame) and reference frame 1 is d1, the distance between the current frame and the reference frame 2 is d2, and the distance between the current frame and the reference frame 3 is d3, then: the initial motion vector of the reference frame 2 is the motion vector 1 * (d2 / d1), and it is subsequently recorded as the motion vector 2 , The initial motion vector of the reference frame 3 is the motion vector 1 * (d3 / d1), and the subsequent motion vector is referred to as the motion vector 3.

Step 333: The encoder obtains the candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame.

In one example, the encoding end obtains the candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame, which may include, but is not limited to, determining the initial motion vector of the candidate reference frame as the center motion vector, and determining the center motion The edge motion vector corresponding to the vector, which is different from the center motion vector; obtain the encoding performance of the center motion vector according to the template of the current image block, and obtain the encoding performance of each edge motion vector according to the template of the current image block; then, According to the coding performance of the central motion vector and the coding performance of each edge motion vector, a candidate motion vector of the candidate reference frame is determined from the central motion vector and the edge motion vector. For each candidate reference frame, the candidate motion vector of the candidate reference frame can be obtained according to the initial motion vector of the candidate reference frame, that is, each candidate reference frame corresponds to one candidate motion vector.

The process of the encoder obtaining the candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame may refer to the fourth embodiment or the fifth embodiment, but replaces the target motion vector in the fourth or the fifth embodiment. For the candidate motion vector of the candidate reference frame, the original motion vector in the fourth or fifth embodiment may be replaced with the initial motion vector of the candidate reference frame.

In step 334, the encoder selects the candidate motion vector with the best coding performance as the target motion vector from the candidate motion vectors of the original reference frame and the candidate motion vectors of each candidate reference frame.

For example, after obtaining the candidate motion vectors of the original reference frame and the candidate motion vectors of each candidate reference frame, the encoding end can obtain the coding performance of each candidate motion vector. For specific acquisition methods, refer to the foregoing fourth embodiment. The motion vector may be replaced with a candidate motion vector. After the coding end obtains the coding performance of each candidate motion vector, it can select the candidate motion vector with the best coding performance as the target motion vector.

Step 335: The encoding end determines the reference frame corresponding to the target motion vector as the target reference frame.

For example, when the target motion vector corresponds to the original reference frame, the encoding end may determine the original reference frame as the target reference frame, and when the target motion vector corresponds to the candidate reference frame, the encoding end may determine the candidate reference frame as the target reference frame.

In this embodiment, a target reference frame is selected from the original reference frame and all candidate reference frames, and the target reference frame is the final reference frame of the current image block. Select the target motion vector (that is, the candidate motion vector with the best coding performance) from the candidate motion vectors of the original reference frame and the candidate motion vectors of all candidate reference frames. The target motion vector is the final motion vector of the current image block, and select The reference frame corresponding to the target motion vector is used as the target reference frame.

Embodiment Nine:

In this embodiment, the original mode information may be the original prediction image block, the target mode information may be the target prediction image block, and the encoding end may obtain the target prediction image block according to the original prediction image block.

Specifically, in the inter-frame coding technology, in order to transmit the current image block of the current frame image, the reference frame image of the current image block can be queried first, that is, the reference frame image can be queried through the reference frame index, and then, from the reference A predicted image block matching the current image block is found in the frame image, and the current image block is encoded based on the difference between the current image block and the predicted image block, thereby reducing the bit transmission amount.

Because there may be a brightness difference between the current image block and the predicted image block, when the current image block is directly encoded with the difference between the current image block and the predicted image block, there may be problems such as poor encoding effect and low encoding performance.

In this embodiment, the predicted image block in the reference frame image is referred to as the original predicted image block, the target predicted image block is obtained according to the original predicted image block, and the current image block is encoded based on the difference between the current image block and the target predicted image block. Instead of directly encoding the current image block based on the difference between the current image block and the original predicted image block. Because the target prediction image block is an image block obtained by using a local illumination compensation algorithm, the brightness difference between the original prediction image block and the current image block can be eliminated, so that the current image block is processed based on the difference between the current image block and the target prediction image block. When encoding, it can effectively solve the problems of poor encoding effect and low encoding performance.

In this embodiment, the encoding end may obtain the original prediction image block of the current image block, and obtain the target prediction image block according to the original prediction image block and the obtained template. Encode the current image block according to the target predicted image block to obtain an encoded bit stream corresponding to the current image block, and send the encoded bit stream to the decoding end.

In an example, the process of obtaining the original predicted image block of the current image block by the encoding end may include, but is not limited to: the encoding end first obtains the reference frame index of the current image block, and queries the reference of the current image block through the reference frame index. A frame image, from which the original predicted image block matching the current image block is queried from the reference frame image.

In an example, the process of obtaining the target predicted image block by the encoding end according to the original predicted image block and the obtained template can refer to the subsequent embodiments.

In an example, the process of encoding the current image block according to the target predicted image block to obtain the encoded bit stream corresponding to the current image block and sending the encoded bit stream to the decoding end may include: obtaining the target predicted image block After that, the current image block can be encoded based on the difference between the current image block and the target predicted image block. There is no restriction on this encoding method. After encoding is completed, the encoded bit stream corresponding to the current image block is obtained, and the encoded bit stream is sent to Decoding end.

When the encoding end uses the target prediction image block to encode the current image block (that is, to encode the current image block based on the difference between the current image block and the target prediction image block), the encoding end sends the encoding bit corresponding to the current image block to the decoding end. The stream carries first indication information; when the encoding end uses the original prediction image block to encode the current image block (that is, to encode the current image block based on the difference between the current image block and the original prediction image block), the encoding end sends to the decoding end The coded bit stream corresponding to the current image block of the second image carries second indication information.

In the above manner, the first indication information or the second indication information is notified explicitly. In practical applications, the first indication information or the second indication information may also be notified implicitly, that is, the encoded bit stream corresponding to the current image block is not included. The first instruction information or the second instruction information is carried. Specifically, the encoding end and the decoding end may also negotiate a decision strategy or define a decision strategy in a standard, and store the decision strategies at the encoding end and the decoding end, respectively. For example, the decision strategy may agree on the first strategy information, or agree on the second strategy information, or agree on the third strategy information. The third policy information is the same policy information as the candidate image block of the current image block.

If the decision strategy agrees with the first strategy information, and the encoding end uses the target prediction image block to encode the current image block, the first indication information or the second indication information may not be carried in the encoded bit stream corresponding to the current image block. If the decision strategy agrees with the second strategy information, and the encoding end uses the original predicted image block to encode the current image block, the first indication information or the second indication information may not be carried in the encoded bit stream corresponding to the current image block. If the decision strategy agrees with the third strategy information, and the candidate image block of the current image block uses the first policy information, and the encoding end uses the target prediction image block to encode the current image block, it may not be carried in the encoded bit stream corresponding to the current image block. The first instruction information or the second instruction information. If the decision strategy agrees with the third strategy information, and the candidate image block of the current image block uses the second strategy information, and the encoding end uses the original predicted image block to encode the current image block, it may not be carried in the encoded bit stream corresponding to the current image block. The first instruction information or the second instruction information.

Embodiment 10:

On the basis of the ninth embodiment, the process of obtaining the target predicted image block by the encoding end according to the original predicted image block and the obtained template. The implementation process can be shown in FIG. 3D.

Step 341: The encoder obtains a motion vector of the current image block and a reference frame index corresponding to the motion vector. The motion vector of the current image block may be the original motion vector in the foregoing embodiment, or the target motion vector in the foregoing embodiment, or may be the final motion vector in the foregoing embodiment, which is not limited as long as The motion vector of the current image block can be obtained. In addition, the reference frame index corresponding to the motion vector is also the index of the reference frame of the current image block.

Step 342: The encoder obtains the reference block corresponding to the template according to the motion vector and the reference frame index of the current image block. For example, a reference frame image is queried by using the reference frame index, and a reference image block matching the current image block is queried from the reference frame image. Then, the reference image block is moved by using the motion vector of the current image block. It is the reference block corresponding to the template, which will be referred to as TMP.

Step 343: The encoding end obtains a transform coefficient according to a template of the current image block and a reference block corresponding to the template. Specifically, the encoding end may obtain a transformation coefficient according to parameter information of each pixel of a template of the current image block and parameter information of each pixel of a reference block corresponding to the template. The parameter information may include, but is not limited to, a brightness value.

For example, see the following formula:

TM _i represents the brightness value of the i-th pixel in the template of the current image block, TMP _i represents the brightness value of the i-th pixel in the reference block corresponding to the template, M represents the total number of pixels of the template, and a and b are transformation coefficients. By adjusting the values of the transformation coefficients a and b, the value of the SSE can also be changed. When the value of SSE is the smallest, the values of the transformation coefficients a and b are the target values, that is, the values of the transformation coefficients a and b are obtained. Among them, the least square method can be used to minimize the value of SSE, and then obtain the values of the transformation coefficients a and b. Of course, other algorithms can also be used, which is not limited.

Step 344: The encoding end performs illumination compensation on the original prediction image block according to the transform coefficient to obtain the target prediction image block. For example, the target prediction image block may be aX + b, where X represents the original prediction image block.

Embodiment 11:

Referring to FIG. 4, which is a schematic flowchart of a decoding method, which is applied to a decoding end, the method may include the following steps:

Step 401: The decoder obtains motion information of a candidate image block of the current image block.

The candidate image block of the current image block may include, but is not limited to, a spatial-domain candidate image block of the current image block; or a time-domain candidate image block of the current image block.

Step 402: The decoder obtains a template of the current image block according to the motion information of the candidate image block.

The method for the decoder to obtain the template of the current image block according to the motion information of the candidate image block is the same as that of the encoder. For details, refer to the related content in the second embodiment.

Step 403: The decoding end decodes the current image block according to the template of the current image block.

In one example, the decoding end decodes the current image block according to the template of the current image block, which may include but is not limited to: obtaining the original mode information of the current image block; obtaining the current image block based on the template of the current image block and the original mode information The target mode information of; the current image block is decoded according to the target mode information. The original mode information is the original motion vector, and the target mode information is the target motion vector. Or, the original mode information is the original motion vector and the original reference frame, and the target mode information is the target motion vector and the target reference frame. Or, the original mode information is The original prediction image block, and the target mode information is the target prediction image block. Of course, the above is only an example, and there is no limitation on this.

In one example, before obtaining the target mode information of the current image block based on the template of the current image block and the original mode information, the decoding end may also obtain a coded bit stream corresponding to the current image block, which may be sent by the encoding end. Yes, it can also be obtained after the decoding end encodes the current image block.

For example, the decoding end may receive the encoded bit stream corresponding to the current image block from the encoding end. If the encoded bit stream carries first indication information, the first indication information is used to instruct to obtain the current image block based on the current image block template and the original mode information. The target mode information of the target image block, the motion information of the candidate image block of the current image block is obtained according to the first instruction information, and the template of the current image block is obtained according to the motion information of the candidate image block.

As another example, the decoding end may receive the encoded bit stream corresponding to the current image block from the encoding end. If the encoded bit stream carries second instruction information, the second instruction information is used to indicate that the encoded bit stream is based on the original mode information corresponding to the current image block. When decoding is performed, the original mode information of the current image block is obtained according to the second instruction information, and the current image block is decoded based on the original mode information.

Wherein, the above manner is to notify the first indication information or the second indication information in an explicit manner. In practical applications, the encoding end may also notify the strategy corresponding to the first indication information or the second indication information in an implicit manner, that is, the current image. The encoded bitstream corresponding to the block does not carry the first indication information or the second indication information. Based on this, the decoding end may also obtain the motion information of the candidate image block of the current image block according to the locally preset first policy information, and obtain the template of the current image block according to the motion information of the candidate image block; The second strategy information is set to obtain the original mode information, and the current image block is decoded based on the original mode information; or, the strategy of the candidate image block of the current image block may also be obtained according to the locally preset third policy information, and based on the The obtained strategy decodes the current image block. The first policy information is used to indicate that target mode information of the current image block is obtained based on the template and original mode information of the current image block; the second policy information is used to indicate that the current image block is decoded based on the original mode information of the current image block; The third policy information is used to indicate that the same policy information as the neighboring image blocks of the current image block is adopted.

Specifically, the encoding end and the decoding end may also negotiate a decision strategy or define a decision strategy in a standard, and store the decision strategy on the encoding end and the decoding end respectively. For example, the decision strategy may agree on the first policy information or agree on the second policy information. Strategy information, or contracted third strategy information. On this basis, if the first indication information and the second indication information are not carried in the encoded bit stream corresponding to the current image block, when the decision policy agrees with the first policy information, the current image block is obtained according to the locally preset first policy information. The candidate image block ’s motion information, and obtain the template of the current image block according to the candidate image block ’s motion information; when the decision policy agrees with the second policy information, the original mode information is obtained according to the locally preset second policy information, and based on The original mode information decodes the current image block; when the decision strategy agrees on the third policy information, if the candidate image block adopts the first strategy information, the motion information of the candidate image block of the current image block is obtained, and the motion information of the candidate image block is obtained according to the candidate image block. Obtain a template of the current image block; when the decision strategy agrees on the third policy information, if the candidate image block adopts the second policy information, obtain the original mode information, and decode the current image block based on the original mode information.

It can be seen from the above that the template of the current image block can be obtained according to the motion information of the candidate image block of the current image block, and the current image block is decoded according to the template of the current image block. Because the above method can quickly obtain the template of the current image block, it can effectively improve decoding efficiency, reduce decoding delay, and improve decoding performance.

Embodiment 12:

In this embodiment, different from the method of generating a template by using reconstruction information and prediction information, a template of the current image block may be obtained according to motion information (such as a motion vector and a reference frame index) of a candidate image block of the current image block. Specifically, the decoding end may then determine a reference frame image of the candidate image block according to the reference frame index, obtain a reference image block of the candidate image block from the reference frame image according to the motion vector, and obtain the reference image block according to the reference image block. The template of the current image block.

The candidate image block may include M first candidate image blocks and N second candidate image blocks, where M is a natural number greater than or equal to 1, N is a natural number greater than or equal to 0, or M is a greater than or equal to 0 Natural numbers, N is a natural number greater than or equal to 1. The first candidate image block is a candidate image block on the upper side of the current image block, and the second candidate image block is a candidate image block on the left side of the current image block. The first candidate image block includes an adjacent image block and / or a second-neighboring image block on the upper side of the current image block; the prediction mode of the adjacent image block is an inter mode or an intra mode; the prediction mode of the next-neighbor image block is inter mode. The second candidate image block includes a neighboring image block and / or a next-neighbor image block on the left side of the current image block. The prediction mode of the adjacent image block is an inter mode or an intra mode; the prediction mode of the next adjacent image block is an inter mode.

Obtaining a template of the current image block according to the motion information of the candidate image block may include, but is not limited to: determining the first template according to the motion vector prediction mode and the motion information of the M first candidate image blocks; Determine the second template according to the motion vector prediction mode and motion information; then, determine the template of the current image block according to the first template and the second template. Specifically, it may be: determining the first template as a template of the current image block; or determining the second template as the template of the current image block; or determining the current image block after splicing the first template and the second template. template.

When M is greater than 1, the above first template may include M sub-templates or P sub-templates, and is composed of M sub-templates or P sub-templates, where P is the number of first candidate image blocks in the inter mode; when M When equal to 1, the first template may include a first sub-template, and the first sub-template is determined according to a motion vector prediction mode and motion information of a candidate image block on the upper side of the current image block. When N is greater than 1, the second template may include N sub-templates or R sub-templates, and is formed by concatenating N sub-templates or R sub-templates, where R is the number of second candidate image blocks in the inter mode; when N is equal to At 1, the second template may include a second sub-template, and the second sub-template is determined according to a motion vector prediction mode and motion information of a candidate image block on the left side of the current image block.

In an example, acquiring a template of the current image block according to the motion information of the candidate image block may further include, but is not limited to, when the current image block corresponds to multiple motion information, acquiring a template corresponding to each motion information and acquiring each motion The weight corresponding to the information, and obtain the template of the current image block according to the weight corresponding to each motion information and the template corresponding to the motion information. The motion information corresponding to the current image block may include original motion information of the current image block.

The processing procedure of the twelfth embodiment is similar to that of the second embodiment.

Embodiment 13:

In this embodiment, the original mode information is the original motion vector of the current image block, and the target mode information is the target motion vector of the current image block. On this basis, the decoder can obtain the original motion vector of the current image block, and obtain a target motion vector according to the original motion vector and the obtained template, and the target motion vector is different from the original motion vector. The decoding end decodes the current image block according to the target motion vector.

For example, the decoding end determines the target motion vector as the final motion vector of the current image block, and uses the final motion vector of the current image block to decode the current image block. There is no restriction on this decoding process.

For the process of obtaining the target motion vector by the decoder based on the original motion vector and the obtained template, refer to the subsequent embodiments.

In an example, the process of obtaining the original motion vector of the current image block by the decoding end may further include: receiving an encoded bit stream corresponding to the current image block from the encoding end, where the encoded bit stream carries the index value of the original motion vector; The motion vector corresponding to the index value is selected from the list as the original motion vector of the current image block. If the index value is 1, the first motion vector in the motion vector list is obtained as the original motion vector of the current image block. The motion vector list is used to record the motion vectors of image blocks adjacent to the current image block. The motion vector list maintained by the decoder is the same as the motion vector list maintained by the encoder. Of course, the above manner is only an example. For example, the motion vector of the candidate image block of the current image block may be determined as the original motion vector of the current image block, or the default motion vector is determined as the original motion vector.

In one example, the decoding end may also parse the first indication information or the second indication information from the encoded bit stream corresponding to the current image block. When the encoded bitstream carries the first instruction information, the target motion vector of the current image block can be obtained according to the original motion vector and the obtained template, and the current image block is decoded by using the target motion vector; when the encoded bitstream carries the second instruction information At this time, the current image block can be decoded according to the original motion vector.

As can be seen from the above, the target motion vector can be obtained based on the original motion vector and the final motion vector of the current image block can be determined based on the target motion vector, instead of directly determining the final motion vector of the current image block based on the original motion vector, thereby effectively improving the motion vector. Accuracy, improving decoding performance. Furthermore, when acquiring a target motion vector according to the original motion vector, a template of the current image block may be acquired according to the motion information of the candidate image block, and a target motion vector may be acquired based on the template of the current image block and the original motion vector. Since the above method can quickly obtain a template of the current image block, and then obtain a target motion vector based on the template, it can effectively improve decoding efficiency and reduce decoding delay. For example, before the decoding reconstruction phase, a template of the current image block can be obtained, and a target motion vector can be obtained according to the template.

Embodiment 14:

Based on the thirteenth embodiment, the process for the decoder to obtain the target motion vector according to the original motion vector and the obtained template. The process is shown in FIG. 5 and may include:

Step 501: The decoding end determines the original motion vector as a central motion vector.

Step 502: The decoder determines an edge motion vector corresponding to the central motion vector. The edge motion vector may be different from the center motion vector.

Determining the edge motion vector corresponding to the central motion vector may include: moving the central motion vector (x, y) in different directions by an offset St to obtain edge motion vectors (x-St, y) in different directions, ( x + St, y), (x, y + St), (x, y-St).

Step 503: The decoder obtains the coding performance of the central motion vector according to the template of the current image block, and obtains the coding performance of each edge motion vector according to the template of the current image block.

The decoding end obtains the encoding performance of the central motion vector according to the template of the current image block, which may include, but is not limited to, the decoding end may determine the central motion vector according to the parameter information of the template of the current image block and the parameter information of the first target reference block. Encoding performance. The first target reference block is an image block obtained after the reference image block corresponding to the template is offset based on the central motion vector.

The decoding end obtains the encoding performance of the edge motion vector according to the template of the current image block, which may include, but is not limited to, the decoding end may determine the edge motion vector according to the parameter information of the template of the current image block and the parameter information of the second target reference block. Encoding performance. The second target reference block is an image block obtained after the reference image block corresponding to the template is offset based on the edge motion vector.

Step 504: The decoding end determines a target motion vector from the center motion vector and the edge motion vector according to the coding performance of the center motion vector and the coding performance of each edge motion vector.

Specifically, the decoding end may select a motion vector with the best coding performance from the center motion vector and the edge motion vector. When the motion vector with the best coding performance is not the original motion vector, the motion vector with the best coding performance can be determined as the target motion vector. When the motion vector with the best coding performance is the original motion vector, a motion vector with the second best coding performance can be selected from the center motion vector and the edge motion vector as the target motion vector.

For the detailed processing flow of steps 501 to 504, refer to Embodiment 4, except that the execution body is changed from the encoding end to the decoding end, and other processing flows are the same.

For the decoding end to obtain the target motion vector according to the original motion vector and the obtained template, Embodiment 5 can also be adopted, but the execution subject is changed from the encoding end to the decoding end.

Embodiment fifteen:

In this embodiment, the original mode information is the original motion vector and the original reference frame of the current image block, and the target mode information is the target motion vector and the target reference frame of the current image block. Based on this, the decoder can obtain the original motion vector and original reference frame of the current image block, and obtain the target motion vector of the current image block based on the template, original motion vector, and original reference frame of the current image block (the target motion vector can be compared with the original motion Vector is different) and the target reference frame, and the current image block is decoded according to the target motion vector and the target reference frame.

The decoding end obtains the target motion vector and the target reference frame of the current image block based on the template, the original motion vector, and the original reference frame of the current image block, which may include, but is not limited to, obtaining the target image based on the template and the original motion vector of the current image block. Candidate motion vector of the original reference frame; Get the initial motion vector of each candidate reference frame according to the original motion vector; Get the candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame; Then, the candidate motion of the original reference frame can be obtained Among the vectors and candidate motion vectors of each candidate reference frame, a candidate motion vector with the best coding performance is selected as the target motion vector, and a reference frame corresponding to the target motion vector is determined as the target reference frame.

The initial motion vector of the candidate reference frame according to the original motion vector may include, but is not limited to, the distance between the frame where the current image block is located and the original reference frame, the distance between the frame where the current image block is located and the candidate reference frame, and the original motion vector. To obtain the initial motion vector of the candidate reference frame.

In an example, obtaining a candidate motion vector of the original reference frame based on a template of the current image block and the original motion vector may include, but is not limited to, determining the original motion vector as a central motion vector and determining that the central motion vector corresponds to the central motion vector. The edge motion vector is different from the center motion vector; then, obtain the encoding performance of the center motion vector according to the template of the current image block, and obtain the encoding performance of each edge motion vector according to the template of the current image block; Then, according to the coding performance of the central motion vector and the coding performance of each edge motion vector, a candidate motion vector of the original reference frame may be determined from the central motion vector and the edge motion vector.

In one example, obtaining the candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame may include, but is not limited to, determining the initial motion vector of the candidate reference frame as a center motion vector, and determining a motion with the center. Vector corresponding edge motion vector, which is different from the center motion vector; obtain the coding performance of the center motion vector and the coding performance of each edge motion vector according to the template of the current image block; according to the coding performance of the center motion vector and each edge motion The coding performance of the vector is to determine the candidate motion vector of the candidate reference frame from the center motion vector and the edge motion vector.

For the detailed implementation process of the fifteenth embodiment, reference may be made to the foregoing seventh embodiment and the eighth embodiment, but the execution subject is changed from the encoding end to the decoding end.

Embodiment Sixteen:

In this embodiment, the original mode information may be an original prediction image block, and the target mode information may be a target prediction image block. Based on this, the decoder can obtain the original predicted image block of the current image block, obtain the target predicted image block of the current image block based on the template of the current image block and the original predicted image block, and decode the current image block according to the target predicted image block .

The decoding end obtains the target predicted image block of the current image block based on the template of the current image block and the original predicted image block, which may include, but is not limited to, the decoding end obtains the transformation coefficient according to the template of the current image block and the reference block corresponding to the template. ; Then, perform illumination compensation on the original predicted image block according to the transform coefficient to obtain the target predicted image block of the current image block.

In one example, before the decoding end obtains the transform coefficient according to the template of the current image block and the reference block corresponding to the template, the decoding end may also obtain the motion vector of the current image block and the reference frame index corresponding to the motion vector; then, A reference block corresponding to the template is obtained according to the motion vector of the current image block and the reference frame index.

In one example, the decoding end obtains the transformation coefficient according to the template of the current image block and the reference block corresponding to the template, which may include but is not limited to: according to parameter information of each pixel of the template of the current image block, and the reference block corresponding to the template The parameter information of each pixel is used to obtain the transformation coefficient. The parameter information may include a brightness value.

For the detailed implementation process of the sixteenth embodiment, reference may be made to the ninth embodiment and the tenth embodiment described above, but the execution body is changed from the encoding end to the decoding end.

Embodiment 17:

Based on the same application concept as the above method, an embodiment of the present application further provides a decoding device, which is applied to the decoding end. As shown in FIG. 6, it is a structural diagram of the device. The device includes: an obtaining module 61, configured to: Acquiring motion information of a candidate image block of the current image block, and acquiring a template of the current image block according to the motion information of the candidate image block; a decoding module 62, configured to perform current analysis on the current image according to the template of the current image block The block is decoded.

When the decoding module 62 decodes the current image block according to the template of the current image block, the decoding module 62 is specifically configured to: obtain original mode information of the current image block; based on the template and the current image block The original mode information acquires target mode information of the current image block; and decodes the current image block according to the target mode information.

The decoding device further includes a receiving module for receiving an encoded bit stream corresponding to a current image block from an encoding end. If the encoded bitstream carries first indication information, the first indication information is used to instruct to obtain target mode information of the current image block based on the template of the current image block and the original mode information, the obtaining The module 61 is further configured to acquire motion information of a candidate image block of the current image block according to the first instruction information, and acquire a template of the current image block according to the motion information of the candidate image block.

If the encoded bitstream carries second indication information, the second indication information is used to instruct the current image block to be decoded based on the original mode information, the decoding module 62 is further configured to use the second indication information according to the second indication information. To obtain the original mode information, and decode the current image block based on the original mode information.

The obtaining module 61 is further configured to obtain the motion information of the candidate image block of the current image block according to the locally preset first policy information, and obtain the template of the current image block according to the motion information of the candidate image block. . The first policy information is used to instruct to obtain target mode information of the current image block based on a template of the current image block and the original mode information.

The decoding module 62 is further configured to obtain the original mode information according to the locally preset second policy information, and decode the current image block based on the original mode information. The second policy information is used to instruct to decode a current image block based on the original mode information.

The decoding module 62 is further configured to decode the current image block according to the locally preset third policy information. The third policy information is the same policy information as the candidate image block of the current image block.

If the original mode information is the original motion vector of the current image block, and the target mode information is the target motion vector of the current image block, the decoding module 62 is based on the template and The obtaining of the target mode information of the current image block by the original mode information is specifically used to determine the original motion vector as a central motion vector; determine an edge motion vector corresponding to the central motion vector, and the edge motion vector Different from the central motion vector; obtaining the coding performance of the central motion vector and the coding performance of each of the edge motion vectors according to the template; the coding performance of the central motion vector and the coding of each of the edge motion vectors according to the template Performance, determining the target motion vector from the center motion vector and each of the edge motion vectors.

If the original mode information is the original motion vector and the original reference frame of the current image block, and the target mode information is the target motion vector and the target reference frame of the current image block, the decoding module 62 is based on the When obtaining the target mode information of the current image block by using the template and the original mode information of the current image block, the method is specifically configured to obtain the original reference frame based on the template of the current image block and the original motion vector. The candidate motion vector of the candidate; obtain the initial motion vector of each candidate reference frame according to the original motion vector; obtain the candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame; Among the motion vectors and the candidate motion vectors of each of the candidate reference frames, a candidate motion vector with the best coding performance is selected as the target motion vector, and a reference frame corresponding to the target motion vector is determined as the target reference frame.

When the decoding module 62 obtains an initial motion vector of a candidate reference frame according to the original motion vector, the decoding module 62 is specifically configured to: according to a distance between a frame where the current image block is located and the original reference frame, a frame where the current image block is located, and the candidate reference frame And the original motion vector to obtain the initial motion vector of the candidate reference frame.

When the decoding module 62 obtains the candidate motion vector of the original reference frame based on the template of the current image block and the original motion vector, the decoding module 62 is specifically configured to: determine the original motion vector as a center motion vector; An edge motion vector corresponding to the center motion vector, the edge motion vector being different from the center motion vector; obtaining the encoding performance of the center motion vector and the encoding performance of each of the edge motion vectors according to the template; The coding performance of the central motion vector and the coding performance of each of the edge motion vectors are described, and a candidate motion vector of the original reference frame is determined from the central motion vector and the edge motion vector.

When the decoding module 62 obtains the candidate motion vector of the candidate reference frame according to the initial motion vector, the decoding module 62 is specifically configured to: determine the initial motion vector of the candidate reference frame as a central motion vector; and determine that the initial motion vector corresponds to the central motion vector. The edge motion vector is different from the center motion vector; obtains the encoding performance of the center motion vector and the encoding performance of each of the edge motion vectors according to the template; and the encoding according to the center motion vector Performance and coding performance of each of the edge motion vectors, and determining the candidate motion vector corresponding to the candidate reference frame from the center motion vector and the edge motion vector.

If the original mode information is an original prediction image block and the target mode information is a target prediction image block, the decoding module 62 acquires the current image based on the template of the current image block and the original mode information The target mode information of the block is specifically used to: obtain a transform coefficient according to the template and a reference block corresponding to the template; perform illumination compensation on the original predicted image block according to the transform coefficient to obtain the target predicted image block .

The decoding module 62 is further configured to: obtain a motion vector of the current image block and a reference frame index corresponding to the motion vector; and obtain a corresponding one of the templates according to the motion vector of the current image block and the reference frame index. Reference block.

The decoding module 62 obtains the transform coefficients according to the template and the reference block corresponding to the template, and is specifically configured to: according to parameter information of each pixel of the template, and each pixel of the reference block corresponding to the template. Parameter information to obtain the transformation coefficient. The parameter information includes a brightness value.

In one example, the candidate image blocks include M first candidate image blocks and N second candidate image blocks, where M is a natural number greater than or equal to 1, N is a natural number greater than or equal to 0, or M is greater than Or a natural number of 0, N is a natural number greater than or equal to 1; the first candidate image block is a candidate image block on the upper side of the current image block, and the second candidate image block is the left side of the current image block When obtaining the template of the current image block according to the motion information of the candidate image block, the obtaining module 61 is specifically configured to determine the motion vector prediction mode and motion information of the M first candidate image blocks A first template; determining a second template according to a motion vector prediction mode and motion information of N second candidate image blocks; determining the first template as a template of the current image block, or determining the second template Determine the template of the current image block, or determine the template of the current image block after stitching the first template and the second template.

In an example, the first candidate image block includes an adjacent image block and / or a second-neighboring image block on the upper side of the current image block; and the prediction mode of the adjacent image block is an inter mode or an intra mode. The prediction mode of the second neighboring image block is an inter mode; the second candidate image block includes a neighboring image block on the left side of the current image block and / or a second neighboring image block. The prediction mode of the adjacent image block is an inter mode or an intra mode; the prediction mode of the next adjacent image block is an inter mode.

When M is greater than 1, the first template includes M sub-templates or P sub-templates, and is formed by splicing the M sub-templates or P sub-templates, where P is the first candidate for the inter-frame mode The number of image blocks; when M is equal to 1, the first template includes a first sub-template, and the first sub-template is based on a motion vector prediction mode and motion information of a candidate image block above the current image block definite.

In an example, the motion information includes a motion vector and a reference frame index of the first candidate image block, and the obtaining module 61 determines the first according to the motion vector prediction mode and motion information of the M first candidate image blocks. The template is specifically used for: for the ith candidate image block of the M first candidate image blocks, when it is determined that the motion vector prediction mode of the ith candidate image block is an inter mode, according to the reference A frame index determines a reference frame image of the i-th candidate image block; and determining a reference image block of the i-th candidate image block from the reference frame image according to a motion vector of the i-th candidate image block, The relative displacement between the reference image block and the i-th candidate image block matches the motion vector of the i-th candidate image block; according to the reference image block, the size is obtained as a first horizontal length and a first vertical The image block of length is used as the ith sub-template included in the first template.

The obtaining module 61 is specifically configured to determine the first template according to the motion vector prediction mode and motion information of the M first candidate image blocks, and for the i-th candidate image block among the M first candidate image blocks, When it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, the i-th candidate image block is filled with a default value, and an image with a size of a first horizontal length and a first vertical length is obtained The block serves as an ith sub-template included in the first template. Alternatively, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, a reference frame corresponding to the i-th candidate image block is determined according to a reference frame index corresponding to the i-th candidate image block An image; determining a reference image block corresponding to the i-th candidate image block from the reference frame image according to a motion vector corresponding to the i-th candidate image block, the reference image block and the i-th candidate image block The relative displacement of the image block matches the motion vector corresponding to the i-th candidate image block; and according to the reference image block, obtaining an image block with a size of a first horizontal length and a first vertical length as the first template includes: I-th child template. The reference frame index and motion vector corresponding to the i-th candidate image block are reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.

The first horizontal length and the horizontal length of the first candidate image block satisfy a first proportional relationship, or the horizontal length of the current image block satisfies a second proportional relationship, or is equal to a first preset length; A longitudinal length satisfies a third proportional relationship with the longitudinal length of the first candidate image block, or satisfies a fourth proportional relationship with the longitudinal length of the current image block, or is equal to a second preset length.

When N is greater than 1, the second template includes N sub-templates or R sub-templates, and is formed by splicing the N sub-templates or R sub-templates, and R is the second candidate of the inter-frame mode. The number of image blocks; when N is equal to 1, the second template includes a second sub-template that is based on a motion vector prediction mode and motion information of a candidate image block to the left of the current image block definite.

In an example, the motion information includes a motion vector and a reference frame index of the second candidate image block, and the acquisition module 61 determines a second vector based on the motion vector prediction mode and motion information of the N second candidate image blocks. The template is specifically used for: for the ith candidate image block of the N second candidate image blocks, when it is determined that the motion vector prediction mode of the ith candidate image block is an inter mode, according to the reference A frame index determines a reference frame image of the i-th candidate image block; and determining a reference image block of the i-th candidate image block from the reference frame image according to a motion vector of the i-th candidate image block, The relative displacement between the reference image block and the i-th candidate image block matches the motion vector of the i-th candidate image block; according to the reference image block, the size is obtained as a second horizontal length and a second vertical The image block of length is used as the ith sub-template included in the second template.

The obtaining module 61 is specifically configured to determine the second template according to the motion vector prediction mode and the motion information of the N second candidate image blocks: for the ith candidate image block of the N second candidate image blocks, When it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, the i-th candidate image block is filled with a default value, and an image with a size of a second horizontal length and a second vertical length is obtained The block serves as an ith sub-template included in the second template. Alternatively, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, a reference frame corresponding to the i-th candidate image block is determined according to a reference frame index corresponding to the i-th candidate image block An image; determining a reference image block corresponding to the i-th candidate image block from the reference frame image according to a motion vector corresponding to the i-th candidate image block, the reference image block and the i-th candidate image block The relative displacement of the image block matches the motion vector corresponding to the i-th candidate image block; according to the determined reference image block, an image block having a second horizontal length and a second vertical length is obtained as the first The template includes the i-th child template. The reference frame index and motion vector corresponding to the i-th candidate image block are reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.

The second horizontal length and the horizontal length of the second candidate image block satisfy a fifth proportional relationship, or the horizontal length of the current image block satisfies a sixth proportional relationship, or is equal to a third preset length; The two vertical lengths satisfy a seventh proportional relationship with the vertical length of the second candidate image block, or satisfy an eighth proportional relationship with the vertical length of the current image block, or are equal to a fourth preset length.

The acquiring module 61 is specifically configured to acquire a template of the current image block according to the motion information of the candidate image block: when the current image block corresponds to multiple motion information, acquire a template corresponding to each motion information, and acquire A weight corresponding to each motion information, and obtaining a template of the current image block according to the weight corresponding to each motion information and a template corresponding to the motion information.

Based on the same application concept as the above method, an embodiment of the present application further proposes an encoding device, which is applied to the encoding end. As shown in FIG. 7, it is a structural diagram of the device. The device includes:

An obtaining module 71 is configured to obtain motion information of a candidate image block of the current image block, and obtain a template of the current image block according to the motion information of the candidate image block; an encoding module 72 is configured to obtain a template according to the current image block. The template encodes the current image block to obtain an encoded bit stream corresponding to the current image block; and a sending module 73 is configured to send the encoded bit stream to a decoding end.

The encoding module 72 encodes the current image block according to the template of the current image block to obtain an encoded bit stream corresponding to the current image block, and is specifically configured to: obtain original mode information of the current image block; based on the Obtaining the target mode information of the current image block by using the template and the original mode information of the current image block; encoding the current image block according to the target mode information to obtain an encoded bit stream corresponding to the current image block.

When the current image block is encoded according to the target mode information, the sending module 73 carries the first instruction information to the encoded bit stream corresponding to the current image block sent by the decoding end, where the first instruction information is used to indicate The template of the current image block and the original mode information obtain target mode information of the current image block.

When the current image block is encoded according to the original mode information, the sending module 73 carries second instruction information to the encoded bit stream corresponding to the current image block sent by the decoding end, where the second instruction information is used to indicate The original mode information is used to decode the current image block.

If the original mode information is the original motion vector of the current image block, and the target mode information is the target motion vector of the current image block, the encoding module 72 is based on the template and The obtaining of the target mode information of the current image block by the original mode information is specifically used to determine the original motion vector as a central motion vector; determine an edge motion vector corresponding to the central motion vector, and the edge motion vector Different from the central motion vector; obtaining the coding performance of the central motion vector and the coding performance of each of the edge motion vectors according to the template; the coding performance of the central motion vector and the coding of each of the edge motion vectors according to the template Performance, determining the target motion vector from the center motion vector and the edge motion vector.

If the original mode information is the original motion vector and the original reference frame of the current image block, and the target mode information is the target motion vector and the target reference frame of the current image block, the encoding module 72 is based on the When obtaining the target mode information of the current image block by using the template and the original mode information of the current image block, the method is specifically configured to obtain the original reference frame based on the template of the current image block and the original motion vector. The candidate motion vector of the candidate; obtain the initial motion vector of each candidate reference frame according to the original motion vector; obtain the candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame; A candidate motion vector with the best coding performance is selected from the motion vectors and the candidate motion vectors of each of the candidate reference frames as the target motion vector, and a reference frame corresponding to the target motion vector is determined as the target reference frame.

When the encoding module 72 obtains the initial motion vector of each candidate reference frame according to the original motion vector, the encoding module 72 is specifically configured to: according to the distance between the frame where the current image block is located and the original reference frame, the frame where the current image block is located, and the candidate reference The distance of the frame and the original motion vector are used to obtain the initial motion vector of the candidate reference frame.

When the encoding module 72 obtains the candidate motion vector of the original reference frame based on the template of the current image block and the original motion vector, the encoding module 72 is specifically configured to: determine the original motion vector as a center motion vector; An edge motion vector corresponding to the center motion vector, the edge motion vector being different from the center motion vector; obtaining the encoding performance of the center motion vector and the encoding performance of each of the edge motion vectors according to the template; The coding performance of the central motion vector and the coding performance of each of the edge motion vectors are described, and a candidate motion vector of the original reference frame is determined from the central motion vector and the edge motion vector.

When the encoding module 72 obtains the candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame, the encoding module 72 is specifically configured to: determine the initial motion vector of the candidate reference frame as a central motion vector; The edge motion vector corresponding to the central motion vector; the edge motion vector is different from the central motion vector; obtaining the encoding performance of the central motion vector and the encoding performance of each of the edge motion vectors according to the template; according to the center The coding performance of a motion vector and the coding performance of each of the edge motion vectors are determined from the center motion vector and the edge motion vector, and the candidate motion vector corresponding to the candidate reference frame.

If the original mode information is an original predicted image block and the target mode information is a target predicted image block, the encoding module 72 obtains the current image based on the template of the current image block and the original mode information The target mode information of the block is specifically used to: obtain a transform coefficient according to the template and a reference block corresponding to the template; perform illumination compensation on the original predicted image block according to the transform coefficient to obtain the target predicted image block .

The encoding module 72 is further configured to: obtain a motion vector of the current image block and a reference frame index corresponding to the motion vector; and obtain a corresponding one of the templates according to the motion vector of the current image block and the reference frame index. Reference block.

The encoding module 72 obtains the transform coefficients according to the template and the reference block corresponding to the template, and is specifically configured to: according to parameter information of each pixel of the template and each pixel of the reference block corresponding to the template. Parameter information to obtain the transformation coefficient. The parameter information includes a brightness value.

The candidate image block includes M first candidate image blocks and N second candidate image blocks, where M is a natural number greater than or equal to 1, N is a natural number greater than or equal to 0, or M is a natural number greater than or equal to 0 , N is a natural number greater than or equal to 1. The first candidate image block is a candidate image block on the upper side of the current image block, and the second candidate image block is a candidate image block on the left side of the current image block. When the obtaining module 71 obtains a template of the current image block according to the motion information of the candidate image block, the acquiring module 71 is specifically configured to: determine the first template according to the motion vector prediction mode and motion information of the M first candidate image blocks; Determine a second template of the motion vector prediction mode and motion information of the N second candidate image blocks; determine the first template as a template of the current image block, or determine the second template as the current image A template of the block, or a template of the current image block determined after stitching the first template and the second template.

The motion information includes a motion vector and a reference frame index of the first candidate image block, and the obtaining module 71 is specifically configured to determine the first template according to the motion vector prediction modes and motion information of the M first candidate image blocks. : For the ith candidate image block of the M first candidate image blocks, when it is determined that the motion vector prediction mode of the ith candidate image block is an inter mode, determine the reference frame index according to the reference frame index A reference frame image of the i-th candidate image block; and determining a reference image block of the i-th candidate image block from the reference frame image according to a motion vector of the i-th candidate image block, the reference image block The relative displacement with the i-th candidate image block matches the motion vector of the i-th candidate image block; according to the reference image block, an image block having a size of a first horizontal length and a first vertical length is obtained as The first template includes an i-th sub-template.

The obtaining module 71 is specifically configured to determine the first template according to the motion vector prediction mode and motion information of the M first candidate image blocks, and for the i-th candidate image block of the M first candidate image blocks, When it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, the i-th candidate image block is filled with a default value, and an image with a size of a first horizontal length and a first vertical length is obtained The block serves as an ith sub-template included in the first template. Alternatively, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, a reference frame corresponding to the i-th candidate image block is determined according to a reference frame index corresponding to the i-th candidate image block An image; determining a reference image block corresponding to the i-th candidate image block from the reference frame image according to a motion vector corresponding to the i-th candidate image block, the reference image block and the i-th candidate image block The relative displacement of the image block matches the motion vector corresponding to the i-th candidate image block; and according to the reference image block, obtaining an image block with a size of a first horizontal length and a first vertical length as the first template includes: I-th child template. The reference frame index and motion vector corresponding to the i-th candidate image block are reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.

The first horizontal length and the horizontal length of the first candidate image block satisfy a first proportional relationship, or the horizontal length of the current image block satisfies a second proportional relationship, or is equal to a first preset length;

The first longitudinal length and the longitudinal length of the first candidate image block satisfy a third proportional relationship, or the longitudinal length of the current image block satisfies a fourth proportional relationship, or is equal to a second preset length.

The motion information includes a motion vector and a reference frame index of the second candidate image block, and the obtaining module 71 is specifically configured to determine the second template according to the motion vector prediction mode and motion information of the N second candidate image blocks. : For the i-th candidate image block of the N second candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an inter mode, determine the according to the reference frame index A reference frame image of the i-th candidate image block; and determining a reference image block of the i-th candidate image block from the reference frame image according to a motion vector of the i-th candidate image block, the reference image block The relative displacement with the i-th candidate image block is matched with the motion vector of the i-th candidate image block; according to the reference image block, an image block having a size of a second horizontal length and a second vertical length is obtained as The second template includes an i-th sub-template.

The obtaining module 71 is specifically configured to determine the second template according to the motion vector prediction mode and motion information of the N second candidate image blocks: for the ith candidate image block of the N second candidate image blocks, When it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, the i-th candidate image block is filled with a default value, and an image with a size of a second horizontal length and a second vertical length is obtained The block serves as an ith sub-template included in the second template. Alternatively, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode, a reference frame corresponding to the i-th candidate image block is determined according to a reference frame index corresponding to the i-th candidate image block An image; determining a reference image block corresponding to the i-th candidate image block from the reference frame image according to a motion vector corresponding to the i-th candidate image block, the reference image block and the i-th candidate image block The relative displacement of the image block matches the motion vector corresponding to the i-th candidate image block; obtaining, according to the reference image block, an image block with a size of a second horizontal length and a second vertical length as the first template includes: I-th child template. The reference frame index and motion vector corresponding to the i-th candidate image block are reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.

The second horizontal length and the horizontal length of the second candidate image block satisfy a fifth proportional relationship, or the horizontal length of the current image block satisfies a sixth proportional relationship, or is equal to a third preset length;

The second vertical length and the vertical length of the second candidate image block satisfy a seventh proportional relationship, or the vertical length of the current image block satisfies an eighth proportional relationship, or is equal to a fourth preset length.

The acquiring module 71 is specifically configured to acquire the template of the current image block according to the motion information of the candidate image block: when the current image block corresponds to multiple motion information, acquire a template corresponding to each motion information, and acquire A weight corresponding to each motion information, and a template of the current image block is obtained according to a weight corresponding to each motion information and a template corresponding to the motion information.

For a decoding end device provided by an embodiment of the present application, a hardware architecture schematic diagram of the decoding end device can be specifically shown in FIG. 8. The processor 81 includes a processor 81 and a machine-readable storage medium 82. The machine-readable storage medium 82 stores machine-executable instructions that can be executed by the processor 81. The processor 81 is configured to execute a machine-executable instruction. Instructions to implement the decoding method disclosed in the above examples of this application.

Based on the same application concept as the above method, an embodiment of the present application further provides a machine-readable storage medium. The machine-readable storage medium stores a number of computer instructions. When the computer instructions are executed by a processor, the present invention can be implemented. Apply for the decoding method disclosed in the above example.

In terms of hardware, the schematic diagram of the hardware architecture of the encoding device provided in the embodiment of this application can be specifically shown in FIG. 9. The processor 91 includes a processor 91 and a machine-readable storage medium 92. The machine-readable storage medium 92 stores machine-executable instructions that can be executed by the processor 91. The processor 91 is configured to execute machine-executable instructions. Instructions to implement the encoding method disclosed in the above example of this application.

Based on the same application concept as the above method, an embodiment of the present application further provides a machine-readable storage medium. The machine-readable storage medium stores a number of computer instructions. When the computer instructions are executed by a processor, the present invention can be implemented. Apply for the encoding method disclosed in the above example.

The machine-readable storage medium may be any electronic, magnetic, optical, or other physical storage device, and may contain or store information, such as executable instructions, data, and so on. For example, the machine-readable storage medium may be: RAM (Radom Access Memory), volatile memory, non-volatile memory, flash memory, storage drive (such as hard drive), solid state hard disk, any type of storage disk (Such as optical discs, DVDs, etc.), or similar storage media, or a combination thereof.

The system, device, module, or unit described in the foregoing embodiments may be specifically implemented by a computer chip or entity, or a product with a certain function. A typical implementation device is a computer, and the specific form of the computer may be a personal computer, a laptop computer, a cellular phone, a camera phone, a smart phone, a personal digital assistant, a media player, a navigation device, an email sending and receiving device, and a game control Desk, tablet computer, wearable device, or a combination of any of these devices.

This application is described with reference to flowcharts and / or block diagrams of methods, devices (systems), and computer program products according to embodiments of the present application. It should be understood that each process and / or block in the flowcharts and / or block diagrams, and combinations of processes and / or blocks in the flowcharts and / or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general-purpose computer, special-purpose computer, embedded processor, or other programmable data processing device to produce a machine such that the instructions generated by the processor of the computer or other programmable data processing device are used to generate instructions Means for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

Furthermore, these computer program instructions may also be stored in a computer-readable memory capable of directing a computer or other programmable data processing device to work in a specific manner, so that the instructions stored in the computer-readable memory produce a manufactured article including an instruction device, The instruction device implements the functions specified in a flowchart or a plurality of processes and / or a block or a plurality of blocks in the block diagram.

In addition, these computer program instructions can also be loaded on a computer or other programmable data processing device, so that a series of operating steps can be performed on the computer or other programmable device to produce a computer-implemented process, thereby being on the computer or other programmable device The executed instructions provide steps for implementing the functions specified in one or more flowcharts and / or one or more blocks of the block diagrams.

The above are only examples of the present application and are not intended to limit the present application. For those skilled in the art, this application may have various modifications and changes. Any modification, equivalent replacement, and improvement made within the spirit and principle of this application shall be included in the scope of claims of this application.

Claims

A decoding method applied to a decoding end, the method includes:

Acquiring motion information of a candidate image block of the current image block;

Obtaining a template of the current image block according to the motion information of the candidate image block;

Decoding the current image block according to the template of the current image block.
The method according to claim 1, wherein decoding the current image block according to the template of the current image block comprises:

Acquiring the original mode information of the current image block;

Acquiring the target mode information of the current image block based on the template of the current image block and the original mode information;

Decoding the current image block according to the target mode information.
The method according to claim 1, wherein:

Before acquiring the target mode information of the current image block based on the template of the current image block and according to the original mode information, the method further includes:

Receiving an encoded bit stream corresponding to the current image block from an encoding end;

Responsive to the encoded bitstream carrying first indication information, wherein the first indication information is used to instruct to obtain target mode information of the current image block based on a template of the current image block and the original mode information;

Acquiring motion information of a candidate image block of the current image block according to the first instruction information; and acquiring a template of the current image block according to the motion information of the candidate image block.
The method according to claim 1, wherein before obtaining the target mode information of the current image block based on the template of the current image block and according to the original mode information, the method further comprises:

Receive the encoded bit stream from the encoding end;

In response to the encoded bit stream carrying second indication information, wherein the second indication information is used to instruct to decode the current image block based on the original mode information;

Acquiring the original mode information according to the second instruction information, and decoding the current image block based on the original mode information.
The method according to claim 1, wherein before obtaining the target mode information of the current image block based on the template of the current image block and according to the original mode information, the method further comprises:

Acquiring the motion information of the candidate image block of the current image block according to the first preset policy information locally; acquiring the template of the current image block according to the motion information of the candidate image block, wherein the first policy information For instructing to acquire a target mode information of the current image block based on the template of the current image block according to the original mode information; or

Acquiring the original mode information according to locally preset second policy information, and decoding the current image block based on the original mode information, wherein the second policy information is used to indicate that the Decoding the current image block; or,

Decoding the current image block according to locally preset third policy information with reference to the policy information used by the candidate image block of the current image block; wherein the third policy information indicates that Candidate image blocks have the same policy information.
The method according to claim 2, wherein:

The original mode information is an original motion vector of the current image block,

The target mode information is a target motion vector of the current image block;

Obtaining the target mode information of the current image block based on the template and the original mode information of the current image block specifically includes:

Determining the original motion vector as a central motion vector;

Determining an edge motion vector corresponding to the central motion vector, the edge motion vector being different from the central motion vector;

Obtaining the encoding performance of the central motion vector and the encoding performance of each of the edge motion vectors according to the template;

The target motion vector is determined from the center motion vector and the edge motion vector according to the coding performance of the center motion vector and the coding performance of each of the edge motion vectors.
The method according to claim 2, wherein:

The original mode information is an original motion vector and an original reference frame of the current image block,

The target mode information is a target motion vector and a target reference frame of the current image block;

Obtaining the target mode information of the current image block based on the template and the original mode information of the current image block specifically includes:

Obtaining a candidate motion vector of the original reference frame based on the template of the current image block and the original motion vector;

For each candidate frame among multiple candidate frames,

Obtaining an initial motion vector of the candidate reference frame according to the original motion vector;

Obtaining a candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame;

Selecting, from the candidate motion vectors of the original reference frame and the candidate motion vectors of the plurality of candidate reference frames, the candidate motion vector with the best coding performance as the target motion vector;

A reference frame corresponding to the target motion vector is determined as the target reference frame.
The method according to claim 7, wherein acquiring the initial motion vector corresponding to the candidate reference frame according to the original motion vector comprises:

Obtaining the initial motion of the candidate reference frame according to the distance between the frame where the current image block is located and the original reference frame, the distance between the frame where the current image block is located and the candidate reference frame, and the original motion vector Vector.
The method according to claim 7, wherein obtaining the candidate motion vector of the original reference frame based on the template of the current image block and the original motion vector comprises:

Determining the original motion vector as a central motion vector;

Determining an edge motion vector corresponding to the central motion vector, the edge motion vector being different from the central motion vector;

Obtaining the encoding performance of the central motion vector and the encoding performance of each of the edge motion vectors according to the template;

According to the coding performance of the central motion vector and the coding performance of each of the edge motion vectors, a candidate motion vector of the original reference frame is determined from the central motion vector and the edge motion vector.
The method according to claim 7 or 8, wherein acquiring the candidate motion vector corresponding to the candidate reference frame according to the initial motion vector of the candidate reference frame comprises:

Determining the initial motion vector of the candidate reference frame as a central motion vector;

Determining an edge motion vector corresponding to the central motion vector; the edge motion vector is different from the central motion vector;

Obtaining the encoding performance of the central motion vector and the encoding performance of each of the edge motion vectors according to the template;

According to the coding performance of the central motion vector and the coding performance of each of the edge motion vectors, the candidate motion vector corresponding to the candidate reference frame is determined from the central motion vector and the edge motion vector.
The method according to claim 2, wherein:

The original mode information is an original predicted image block,

The target mode information is a target prediction image block,

Obtaining the target mode information of the current image block based on the template and the original mode information of the current image block specifically includes:

Obtaining transform coefficients according to the template and a reference block corresponding to the template;

Illumination compensation is performed on the original prediction image block according to the transform coefficient to obtain the target prediction image block.
The method according to claim 11, wherein before acquiring the transform coefficient according to the template and a reference block corresponding to the template, further comprising:

Acquiring a motion vector of the current image block and a reference frame index corresponding to the motion vector;

Obtaining a reference block corresponding to the template according to the motion vector and the reference frame index of the current image block.
The method according to claim 11, wherein obtaining the transform coefficient according to the template and a reference block corresponding to the template comprises:

Obtaining the transformation coefficient according to parameter information of each pixel of the template and parameter information of each pixel of a reference block corresponding to the template;

The parameter information includes a brightness value.
The method according to any one of claims 1 to 13, characterized in that:

The candidate image block includes M first candidate image blocks and N second candidate image blocks, where M is a natural number greater than or equal to 1, N is a natural number greater than or equal to 0, or M is a natural number greater than or equal to 0 , N is a natural number greater than or equal to 1;

The first candidate image block is a candidate image block above the current image block,

The second candidate image block is a candidate image block to the left of the current image block;

Obtaining a template of the current image block according to the motion information of the candidate image block includes:

Determining a first template according to a motion vector prediction mode and motion information of the M first candidate image blocks;

Determine a second template according to the motion vector prediction mode and motion information of the N second candidate image blocks;

Determining the first template as a template of the current image block, or determining the second template as a template of the current image block, or stitching the first template and the second template as A template of the current image block.
The method according to claim 14, wherein:

The first candidate image block includes an adjacent image block and / or a second-neighbor image block on the upper side of the current image block; a prediction mode of the adjacent image block is an inter mode or an intra mode; and the second neighbor The prediction mode of the image block is an inter mode;

The second candidate image block includes an adjacent image block and / or a second-neighbor image block to the left of the current image block; a prediction mode of the adjacent image block is an inter mode or an intra mode; and the second neighbor The prediction mode of an image block is an inter mode.
The method according to claim 14, wherein:

When M is greater than 1, the first template includes M sub-templates or P sub-templates, and is formed by splicing the M sub-templates or P sub-templates, where P is the first candidate for the inter-frame mode The number of image blocks;

When M is equal to 1, the first template includes a first sub-template, and the first sub-template is determined according to a motion vector prediction mode and motion information of a candidate image block on an upper side of the current image block.
The method according to claim 16, wherein:

The motion information includes a motion vector and a reference frame index of the first candidate image block,

Determining the first template according to the motion vector prediction mode and motion information of the M first candidate image blocks includes:

For the i-th candidate image block among the M first candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an inter mode,

Determining a reference frame image of the i-th candidate image block according to the reference frame index;

Determining a reference image block of the i-th candidate image block from the reference frame image according to a motion vector of the i-th candidate image block, the relative of the reference image block and the i-th candidate image block The displacement matches the motion vector of the i-th candidate image block;

According to the reference image block, an image block having a first horizontal length and a first vertical length is obtained as an i-th sub-template included in the first template.
The method according to claim 16, wherein determining the first template according to a motion vector prediction mode and motion information of the M first candidate image blocks comprises:

For the i-th candidate image block among the M first candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode,

Fill the i-th candidate image block with a default value, and

Acquiring an image block having a first horizontal length and a first vertical length as an i-th sub-template included in the first template;

Alternatively, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode,

Determining a reference frame image corresponding to the i-th candidate image block according to a reference frame index corresponding to the i-th candidate image block;

Determining a reference image block corresponding to the i-th candidate image block from the reference frame image according to a motion vector corresponding to the i-th candidate image block, the reference image block and the i-th candidate image block The relative displacement of is matched with the motion vector corresponding to the i-th candidate image block;

Obtaining, according to the reference image block, an image block having a first horizontal length and a first vertical length as an i-th sub-template included in the first template;

The reference frame index and motion vector corresponding to the i-th candidate image block are reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.
The method according to claim 17 or 18, wherein:

The first horizontal length and the horizontal length of the first candidate image block satisfy a first proportional relationship, or the horizontal length of the current image block satisfies a second proportional relationship, or is equal to a first preset length;

The first vertical length satisfies a third proportional relationship with the vertical length of the first candidate image block, or satisfies a fourth proportional relationship with the vertical length of the current image block, or is equal to a second preset length.
The method according to claim 14, wherein:

When N is greater than 1, the second template includes N sub-templates or R sub-templates, and is formed by splicing the N sub-templates or R sub-templates, and R is the second candidate of the inter-frame mode. The number of image blocks;

When N is equal to 1, the second template includes a second sub-template, and the second sub-template is determined according to a motion vector prediction mode and motion information of a candidate image block on the left side of the current image block.
The method according to claim 20, wherein:

The motion information includes a motion vector and a reference frame index of the second candidate image block,

Determining the second template according to the motion vector prediction mode and motion information of the N second candidate image blocks, including:

For the ith candidate image block among the N second candidate image blocks,

When it is determined that the motion vector prediction mode of the i-th candidate image block is an inter mode, determining a reference frame image of the i-th candidate image block according to the reference frame index;

Determining a reference image block of the i-th candidate image block from the reference frame image according to a motion vector of the i-th candidate image block, the The displacement matches the motion vector of the i-th candidate image block;

According to the reference image block, an image block having a second horizontal length and a second vertical length is obtained as an i-th sub-template included in the second template.
The method according to claim 21, wherein determining the second template according to a motion vector prediction mode and motion information of the N second candidate image blocks further comprises:

When it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode,

Fill the i-th candidate image block with a default value, and

Acquiring an image block having a second horizontal length and a second vertical length as an i-th sub-template included in the second template;

Alternatively, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode,

Determining a reference frame image corresponding to the i-th candidate image block according to a reference frame index corresponding to the i-th candidate image block;

Determining a reference image block corresponding to the i-th candidate image block from the reference frame image according to a motion vector corresponding to the i-th candidate image block, the reference image block and the i-th candidate image block The relative displacement of is matched with the motion vector corresponding to the i-th candidate image block;

Obtaining, according to the reference image block, an image block having a second horizontal length and a second vertical length as an i-th sub-template included in the first template;

The reference frame index and motion vector corresponding to the i-th candidate image block are reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.
The method according to claim 21 or 22, wherein:

The second horizontal length and the horizontal length of the second candidate image block satisfy a fifth proportional relationship, or the horizontal length of the current image block satisfies a sixth proportional relationship, or is equal to a third preset length;

The second vertical length and the vertical length of the second candidate image block satisfy a seventh proportional relationship, or the vertical length of the current image block satisfies an eighth proportional relationship, or is equal to a fourth preset length.
The method according to any one of claims 14 to 23, wherein acquiring a template of the current image block according to the motion information of the candidate image block comprises:

When the current image block corresponds to a plurality of motion information, obtaining a template corresponding to each motion information, wherein the motion information corresponding to the current image block may include the original motion information of the current image block;

Obtain the weight corresponding to each sport information, and

A template of the current image block is obtained according to a weight corresponding to each motion information and a template corresponding to the motion information.
An encoding method applied to an encoding end, the method including:

Acquiring motion information of a candidate image block of the current image block;

Obtaining a template of the current image block according to the motion information of the candidate image block;

Encoding the current image block according to the template of the current image block.
The method according to claim 25, wherein encoding the current image block according to the template of the current image block comprises:

Acquiring original mode information of the current image block;

Acquiring target mode information of the current image block based on the template of the current image block and the original mode information;

Encode the current image block according to the target mode information to obtain an encoded bit stream corresponding to the current image block.
The method according to claim 26, further comprising:

When the current image block is encoded according to the target mode information, the encoded bitstream corresponding to the current image block sent to the decoding end carries first indication information, where the first indication information is used to indicate The template of the current image block and the original mode information acquire target mode information of the current image block.
The method according to claim 26, further comprising:

When the current image block is encoded according to the original mode information, the encoded bit stream corresponding to the current image block sent to the decoding end carries the encoded bit stream of the second instruction information, where the second instruction information is used for And instructing to decode the current image block based on the original mode information.
The method according to claim 26, wherein:

The original mode information is an original motion vector of the current image block,

The target mode information is a target motion vector of the current image block;

Obtaining target mode information of the current image block based on the template and the original mode information of the current image block specifically includes:

Determining the original motion vector as a central motion vector;

Determining an edge motion vector corresponding to the central motion vector, the edge motion vector being different from the central motion vector;

Obtaining the encoding performance of the central motion vector and the encoding performance of each of the edge motion vectors according to the template;

The target motion vector is determined from the center motion vector and the edge motion vector according to the coding performance of the center motion vector and the coding performance of each of the edge motion vectors.
The method according to claim 26, wherein:

The original mode information is an original motion vector and an original reference frame of the current image block,

The target mode information is a target motion vector and a target reference frame of the current image block;

Obtaining target mode information of the current image block based on the template and the original mode information of the current image block specifically includes:

Obtaining a candidate motion vector of the original reference frame based on the template of the current image block and the original motion vector;

For each candidate frame among multiple candidate frames,

Obtaining an initial motion vector of the candidate reference frame according to the original motion vector;

Obtaining a candidate motion vector of the candidate reference frame according to the initial motion vector of the candidate reference frame;

Selecting, from the candidate motion vectors of the original reference frame and the candidate motion vectors of the plurality of candidate reference frames, the candidate motion vector with the best coding performance as the target motion vector;

A reference frame corresponding to the target motion vector is determined as the target reference frame.
The method according to claim 30, wherein acquiring the initial motion vector corresponding to the candidate reference frame according to the original motion vector comprises:

Obtaining the initial motion vector of the candidate reference frame according to the distance between the frame where the current image block is located and the original reference frame, the distance between the frame where the current image block is located and the candidate reference frame, and the original motion vector.
The method according to claim 30, wherein obtaining a candidate motion vector of the original reference frame based on the template of the current image block and the original motion vector comprises:

Determining the original motion vector as a central motion vector;

Determining an edge motion vector corresponding to the central motion vector, the edge motion vector being different from the central motion vector;

Obtaining the encoding performance of the central motion vector and the encoding performance of each of the edge motion vectors according to the template;

According to the coding performance of the central motion vector and the coding performance of each of the edge motion vectors, a candidate motion vector of the original reference frame is determined from the central motion vector and the edge motion vector.
The method according to claim 30 or 31, wherein acquiring the candidate motion vector corresponding to the candidate reference frame according to the initial motion vector of the candidate reference frame comprises:

Determining an initial motion vector of the candidate reference frame as a central motion vector;

Determining an edge motion vector corresponding to the central motion vector; the edge motion vector is different from the central motion vector;

Obtaining the encoding performance of the central motion vector and the encoding performance of each of the edge motion vectors according to the template;

According to the coding performance of the central motion vector and the coding performance of each of the edge motion vectors, the candidate motion vector corresponding to the candidate reference frame is determined from the central motion vector and the edge motion vector.
The method according to claim 26, wherein:

The original mode information is an original predicted image block,

The target mode information is a target prediction image block,

Obtaining the target mode information of the current image block based on the template and the original mode information of the current image block specifically includes:

Obtaining transform coefficients according to the template and a reference block corresponding to the template;

Illumination compensation is performed on the original prediction image block according to the transform coefficient to obtain the target prediction image block.
The method according to claim 34, wherein before acquiring the transform coefficient according to the template and a reference block corresponding to the template, further comprising:

Acquiring a motion vector of the current image block and a reference frame index corresponding to the motion vector;

Obtaining a reference block corresponding to the template according to the motion vector and the reference frame index of the current image block.
The method according to claim 34, wherein obtaining the transformation coefficient according to the template and a reference block corresponding to the template comprises:

Obtaining the transformation coefficient according to parameter information of each pixel of the template and parameter information of each pixel of a reference block corresponding to the template;

The parameter information includes a brightness value.
The method according to any one of claims 26 to 36, wherein

The candidate image block includes M first candidate image blocks and N second candidate image blocks, where M is a natural number greater than or equal to 1, N is a natural number greater than or equal to 0, or M is a natural number greater than or equal to 0 , N is a natural number greater than or equal to 1;

The first candidate image block is a candidate image block above the current image block,

The second candidate image block is a candidate image block to the left of the current image block;

Obtaining a template of the current image block according to the motion information of the candidate image block includes:

Determining a first template according to a motion vector prediction mode and motion information of the M first candidate image blocks;

Determine a second template according to the motion vector prediction mode and motion information of the N second candidate image blocks;

Determining the first template as a template of the current image block, or determining the second template as a template of the current image block, or stitching the first template and the second template as A template of the current image block.
The method according to claim 37, wherein:

The first candidate image block includes an adjacent image block and / or a second-neighbor image block on the upper side of the current image block; a prediction mode of the adjacent image block is an inter mode or an intra mode; and the second neighbor The prediction mode of the image block is an inter mode;

The second candidate image block includes an adjacent image block and / or a second-neighbor image block to the left of the current image block; a prediction mode of the adjacent image block is an inter mode or an intra mode; and the second neighbor The prediction mode of an image block is an inter mode.
The method according to claim 37, wherein:

When M is greater than 1, the first template includes M sub-templates or P sub-templates, and is formed by splicing the M sub-templates or P sub-templates, where P is the first candidate for the inter-frame mode The number of image blocks;

When M is equal to 1, the first template includes a first sub-template, and the first sub-template is determined according to a motion vector prediction mode and motion information of a candidate image block on an upper side of the current image block.
The method according to claim 39, wherein:

The motion information includes a motion vector and a reference frame index of the first candidate image block,

Determining the first template according to the motion vector prediction mode and motion information of the M first candidate image blocks includes:

For the i-th candidate image block among the M first candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an inter mode,

Determining a reference frame image of the i-th candidate image block according to the reference frame index;

Determining a reference image block of the i-th candidate image block from the reference frame image according to a motion vector of the i-th candidate image block, the relative of the reference image block and the i-th candidate image block The displacement matches the motion vector of the i-th candidate image block;

According to the reference image block, an image block having a first horizontal length and a first vertical length is obtained as an i-th sub-template included in the first template.
The method according to claim 40, wherein determining the first template according to a motion vector prediction mode and motion information of the M first candidate image blocks further comprises:

For the i-th candidate image block among the M first candidate image blocks, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode,

Fill the i-th candidate image block with a default value, and

Acquiring an image block having a first horizontal length and a first vertical length as an i-th sub-template included in the first template;

Alternatively, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode,

Determining a reference frame image corresponding to the i-th candidate image block according to a reference frame index corresponding to the i-th candidate image block;

Determining a reference image block corresponding to the i-th candidate image block from the reference frame image according to a motion vector corresponding to the i-th candidate image block, the reference image block and the i-th candidate image block The relative displacement of is matched with the motion vector corresponding to the i-th candidate image block;

Obtaining, according to the reference image block, an image block having a first horizontal length and a first vertical length as an i-th sub-template included in the first template;

The reference frame index and motion vector corresponding to the i-th candidate image block are reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.
The method according to claim 40 or 41, wherein:

The first horizontal length and the horizontal length of the first candidate image block satisfy a first proportional relationship, or the horizontal length of the current image block satisfies a second proportional relationship, or is equal to a first preset length;

The first longitudinal length and the longitudinal length of the first candidate image block satisfy a third proportional relationship, or the longitudinal length of the current image block satisfies a fourth proportional relationship, or is equal to a second preset length.
The method according to claim 37, wherein:

When N is greater than 1, the second template includes N sub-templates or R sub-templates, and is formed by splicing the N sub-templates or R sub-templates, and R is the second candidate of the inter-frame mode. The number of image blocks;

When N is equal to 1, the second template includes a second sub-template, and the second sub-template is determined according to a motion vector prediction mode and motion information of a candidate image block on the left side of the current image block.
The method according to claim 43, wherein:

The motion information includes a motion vector and a reference frame index of the second candidate image block,

Determining the second template according to the motion vector prediction mode and motion information of the N second candidate image blocks, including:

For the ith candidate image block of the N second candidate image blocks, when it is determined that the motion vector prediction mode of the ith candidate image block is an inter mode,

Determining a reference frame image of the i-th candidate image block according to the reference frame index;

Determining a reference image block of the i-th candidate image block from the reference frame image according to a motion vector of the i-th candidate image block, the relative of the reference image block and the i-th candidate image block The displacement matches the motion vector of the i-th candidate image block;

According to the reference image block, an image block having a second horizontal length and a second vertical length is obtained as an i-th sub-template included in the second template.
The method according to claim 43, wherein determining the second template according to the motion vector prediction mode and motion information of the N second candidate image blocks further comprises:

For the ith candidate image block of the N second candidate image blocks, when it is determined that the motion vector prediction mode of the ith candidate image block is an intra mode,

Fill the i-th candidate image block with a default value, and

Acquiring an image block having a second horizontal length and a second vertical length as an i-th sub-template included in the second template;

Alternatively, when it is determined that the motion vector prediction mode of the i-th candidate image block is an intra mode,

Determining a reference frame image corresponding to the i-th candidate image block according to a reference frame index corresponding to the i-th candidate image block;

Determining a reference image block corresponding to the i-th candidate image block from the reference frame image according to a motion vector corresponding to the i-th candidate image block, the reference image block and the i-th candidate image block The relative displacement of is matched with the motion vector corresponding to the i-th candidate image block;

Obtaining, according to the reference image block, an image block having a second horizontal length and a second vertical length as an i-th sub-template included in the first template;

The reference frame index and motion vector corresponding to the i-th candidate image block are reference frame indexes and motion vectors of neighboring image blocks of the i-th candidate image block.
The method according to claim 44 or 45, wherein:

The second horizontal length and the horizontal length of the second candidate image block satisfy a fifth proportional relationship, or the horizontal length of the current image block satisfies a sixth proportional relationship, or is equal to a third preset length;

The second vertical length and the vertical length of the second candidate image block satisfy a seventh proportional relationship, or the vertical length of the current image block satisfies an eighth proportional relationship, or is equal to a fourth preset length.
The method according to any one of claims 37 to 46, wherein obtaining a template of the current image block according to the motion information of the candidate image block comprises:

When the current image block corresponds to a plurality of motion information, obtaining a template corresponding to each motion information, wherein the motion information corresponding to the current image block may include the original motion information of the current image block;

Obtain the weight corresponding to each sport information, and

A template of the current image block is obtained according to a weight corresponding to each motion information and a template corresponding to the motion information.
A decoding device includes:

Processor; and

A machine-readable storage medium storing machine-executable instructions executable by the processor;

The processor is configured to execute the machine-executable instructions to implement the method steps of any one of claims 1-24.
An encoding end device includes:

Processor; and

A machine-readable storage medium storing machine-executable instructions executable by the processor;

The processor is configured to execute machine-executable instructions to implement the method steps of any one of claims 25-47.