WO2021114100A1

WO2021114100A1 - Intra-frame prediction method, video encoding and decoding methods, and related device

Info

Publication number: WO2021114100A1
Application number: PCT/CN2019/124362
Authority: WO
Inventors: 张云; 朱林卫; 皮金勇
Original assignee: 中国科学院深圳先进技术研究院
Priority date: 2019-12-10
Filing date: 2019-12-10
Publication date: 2021-06-17

Abstract

An intra-frame prediction method, video encoding and decoding methods, and a related device, the intra-frame prediction method comprising: acquiring image information of a current coding block and image information of an adjacent coding block, the adjacent coding block being an encoded or decoded reconstructed coding block; on the basis of the image information of the adjacent coding block and at least one preset intra-frame prediction mode, calculating at least one first prediction value of the adjacent coding block for intra-frame prediction of the current coding block and, on the basis of the at least one first prediction value, constructing a mode matrix; on the basis of the mode matrix and a preset algorithm, determining at least one mode set; on the basis of the image information of the adjacent coding block and the mode set, calculating at least one second prediction value of the adjacent coding block for intra-frame prediction of the current coding block, and using the second prediction value with the smallest difference to the true value as the prediction result of the current coding block. The present intra-frame prediction method can improve encoding performance.

Description

Intra-frame prediction method, video encoding and decoding method and related equipment

Technical field

This application relates to the technical field of video processing, in particular to intra-frame prediction methods, video encoding and decoding methods and related equipment.

Background technique

At present, video plays an important role in people's lives and work, such as online learning, video entertainment, security monitoring, telemedicine, etc., and its data volume accounts for more than 80% of the entire Internet traffic. With the higher demand of users for video, the amount of video data has exploded. However, the compression efficiency of video coding has never been able to keep up with the increase in the amount of video data. Therefore, more efficient video coding algorithms need to be studied.

Intra-frame prediction is an important part of video coding, and the parameters of existing intra-frame prediction methods are relatively fixed. However, video content is diverse, and fixed parameter prediction methods cannot achieve better coding performance.

Summary of the invention

technical problem

The purpose of the embodiments of the present application is to provide an intra-frame prediction method, a video encoding and decoding method, and related equipment, so as to improve the encoding performance of video encoding.

The solution to the problem

Technical solutions

In order to solve the above technical problems, the technical solutions adopted in the embodiments of this application are:

The first aspect of the embodiments of the present application provides an intra-frame prediction method, including:

Acquiring image information of the current encoding block and image information of adjacent encoding blocks, where the adjacent encoding blocks are encoded or decoded and reconstructed encoding blocks;

According to the image information of the adjacent coding block and at least one preset intra prediction mode, at least one first prediction value of the adjacent coding block for intra prediction of the current coding block is calculated, wherein each first prediction value is One prediction value corresponds to one intra prediction mode;

Constructing a mode matrix according to the at least one first predicted value;

At least one mode combination is determined according to the mode matrix and a preset algorithm, and at least one of the intra-frame prediction of the current coding block by the neighboring coding block is calculated according to the image information of the neighboring coding block and the mode combination The second prediction value, where each second prediction value corresponds to a mode combination, and each mode combination includes at least one first prediction value and a weight coefficient corresponding to each first prediction value;

Obtain the true value of the current encoding block according to the image information of the current encoding block, and use the second predicted value with the smallest difference from the true value as the prediction result of the current encoding block.

The second aspect of the embodiments of the present application provides a video encoding method, which is applied to a video encoder, and the video encoding method includes:

Acquiring image information of a current encoding block and image information of adjacent encoding blocks, where the adjacent encoding blocks are encoded and reconstructed encoding blocks;

Perform intra-frame prediction on the current coding block according to the image information of the adjacent coding block and at least two prediction strategies, calculate the rate-distortion cost value of each prediction strategy, and use the prediction strategy with the least rate-distortion cost value as the target prediction Strategy, wherein the at least two prediction strategies include a first prediction strategy and a second prediction strategy, and the first prediction strategy is the intra-frame prediction method described in the first aspect;

Calculating a third prediction value for performing intra-frame prediction of the current coding block by the target prediction strategy;

Obtaining the real value of the current coding block according to the image information of the current coding block, and calculating a prediction residual according to the real value and the third predicted value;

Encoding is performed according to the target prediction strategy and the prediction residual, and a video code stream is generated according to the encoding result.

The third aspect of the embodiments of the present application provides a video decoding method, which is applied to a video decoder, and the video decoding method includes:

Obtain video stream;

Decoding the video code stream to obtain a strategy identifier and a prediction residual;

Determine a target prediction strategy from at least two prediction strategies according to the strategy identifier, the at least two prediction strategies including a first prediction strategy and a second prediction strategy, and the first prediction strategy is the frame described in the first aspect above Intra-prediction method;

Perform video reconstruction according to the target prediction strategy and the prediction residual.

A fourth aspect of the embodiments of the present application provides an intra-frame prediction device, including:

The first acquisition module is configured to acquire image information of the current encoding block and image information of adjacent encoding blocks, where the adjacent encoding blocks are encoded or decoded and reconstructed encoding blocks;

The first calculation module is configured to calculate at least one first prediction of intra prediction of the current coding block by the neighboring coding block according to the image information of the neighboring coding block and at least one preset intra prediction mode Value, where each first prediction value corresponds to an intra prediction mode;

A construction module, configured to construct a mode matrix according to the at least one first predicted value;

The first determining module is configured to determine at least one mode combination according to the mode matrix and a preset algorithm, and calculate the comparison between the adjacent coding block and the current coding block according to the image information of the adjacent coding block and the mode combination At least one second predicted value for intra-frame prediction, where each second predicted value corresponds to a mode combination, and each mode combination includes at least one first predicted value and a weight coefficient corresponding to each first predicted value;

The prediction module is configured to obtain the real value of the current coding block according to the image information of the current coding block, and use the second predicted value with the smallest difference from the real value as the prediction result of the current coding block.

A fifth aspect of the embodiments of the present application provides a video encoding device, including:

The second acquiring module is configured to acquire the image information of the current encoding block and the image information of the adjacent encoding block, wherein the adjacent encoding block is an encoded and reconstructed encoding block;

The second determining module is configured to perform intra-frame prediction on the current coding block according to the image information of the adjacent coding block and at least two prediction strategies, calculate the rate-distortion cost value of each prediction strategy, and replace the rate-distortion cost value The smallest prediction strategy is used as the target prediction strategy, wherein the at least two prediction strategies include a first prediction strategy and a second prediction strategy, and the first prediction strategy is the intra prediction method described in the first aspect;

A second calculation module, configured to calculate a third prediction value for intra-frame prediction of the current coding block by the target prediction strategy;

A third calculation module, configured to obtain the true value of the current encoding block according to the image information of the current encoding block, and calculate a prediction residual according to the true value and the third predicted value;

The encoding module is used for encoding according to the target prediction strategy and the prediction residual, and generating a video code stream according to the encoding result.

A sixth aspect of the embodiments of the present application provides a video decoding device, including:

The third acquisition module is used to acquire the video code stream;

The decoding module is used to decode the video code stream to obtain a strategy identifier and a prediction residual;

The third determining module is configured to determine a target prediction strategy from at least two prediction strategies according to the strategy identifier, the at least two prediction strategies including a first prediction strategy and a second prediction strategy, and the first prediction strategy is the above The intra-frame prediction method described in the first aspect;

The video reconstruction module is configured to perform video reconstruction according to the target prediction strategy and the prediction residual.

The seventh aspect of the embodiments of the present application provides a terminal device, including a memory, a processor, and a computer program stored in the memory and running on the processor. When the processor executes the computer program, Implement the method described in the first aspect above.

An eighth aspect of the embodiments of the present application provides a video encoder, including a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes The computer program implements the method described in the second aspect above.

A ninth aspect of the embodiments of the present application provides a video decoder, including a memory, a processor, and a computer program stored in the memory and running on the processor, and the processor executes the computer program When realizing the method described in the third aspect above.

A tenth aspect of the embodiments of the present application provides a video processing system, including the video encoder described in the eighth aspect and the video decoder described in the ninth aspect.

The eleventh aspect of the embodiments of the present application provides a computer-readable storage medium, the computer-readable storage medium stores a computer program, and when the computer program is executed by a processor, the first aspect, second aspect, or The third issue is the steps of the method.

The twelfth aspect of the embodiments of the present application provides a computer program product, which when the computer program product runs on a terminal device, causes the terminal device to execute the steps of the method described in the first aspect, the second aspect, or the third aspect.

Compared with the prior art, the embodiment of this application has the following beneficial effects: by acquiring the image information of the current encoding block and the image information of the adjacent encoding block, according to the image information of the adjacent encoding block and at least one preset intra prediction The mode calculates at least one first prediction value of the adjacent coding block for intra-frame prediction of the current coding block, constructs a mode matrix according to the at least one first prediction value, determines at least one mode combination according to the mode matrix and a preset algorithm, and determines the The real value of the current coding block is obtained from the image information, and the second predicted value with the smallest difference from the real value is used as the prediction result of the current coding block. Since the residual error corresponding to the second predicted value with the smallest difference between the true value is the smallest, the bit rate can be saved in video encoding, therefore, the intra-frame prediction method provided in this application has better coding performance than the fixed-parameter prediction method.

The beneficial effects of the invention

Brief description of the drawings

Description of the drawings

In order to more clearly describe the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings that need to be used in the embodiments or exemplary technical descriptions.

Fig. 1 is a flowchart of an intra-frame prediction method provided by an embodiment of the present application;

Fig. 2 is a schematic structural diagram of an intra-frame prediction apparatus provided by an embodiment of the present application;

Fig. 3 is a schematic diagram of a video processing system provided by an embodiment of the present application;

Figure 4 is a flowchart of a video encoding method provided by an embodiment of the present application;

FIG. 5 is a schematic diagram of an encoding process of a video encoder provided by an embodiment of the present application;

Fig. 6 is a schematic diagram of a video encoding device provided by an embodiment of the present application;

Fig. 7 is a flowchart of a video decoding method provided by an embodiment of the present application;

FIG. 8 is a schematic diagram of a decoding process of a video decoder provided by an embodiment of the present application;

FIG. 9 is a schematic diagram of a video decoding device provided by an embodiment of the present application;

FIG. 10 is a schematic diagram of a terminal device provided by an embodiment of the present application;

FIG. 11 is a schematic diagram of a video encoder provided by an embodiment of the present application;

Fig. 12 is a schematic diagram of a video decoder provided by an embodiment of the present application.

Invention embodiment

Embodiments of the present invention

In the following description, for the purpose of illustration rather than limitation, specific details such as a specific system structure and technology are proposed for a thorough understanding of the embodiments of the present application. However, it should be clear to those skilled in the art that the present application can also be implemented in other embodiments without these specific details. In other cases, detailed descriptions of well-known systems, devices, circuits, and methods are omitted to avoid unnecessary details from obstructing the description of this application.

In order to illustrate the technical solutions described in the present application, specific embodiments are used for description below.

It should be understood that when used in this specification and the appended claims, the term "comprising" indicates the existence of the described features, wholes, steps, operations, elements and/or components, but does not exclude one or more other features , The existence or addition of a whole, a step, an operation, an element, a component, and/or a collection thereof.

It should also be understood that the terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in the specification of this application and the appended claims, unless the context clearly indicates other circumstances, the singular forms "a", "an" and "the" are intended to include plural forms.

It should be further understood that the term "and/or" used in the specification and appended claims of this application refers to any combination and all possible combinations of one or more of the associated listed items, and includes these combinations .

As used in this specification and the appended claims, the term "if" can be interpreted as "when" or "once" or "in response to determination" or "in response to detection" depending on the context . Similarly, the phrase "if determined" or "if detected [described condition or event]" can be interpreted as meaning "once determined" or "in response to determination" or "once detected [described condition or event]" depending on the context ]" or "in response to detection of [condition or event described]".

In addition, in the description of the present application, the terms "first", "second", etc. are only used to distinguish the description, and cannot be understood as indicating or implying relative importance.

The intra-frame prediction method provided in the embodiment of the present application is applied to a terminal device. As shown in FIG. 1, the intra prediction method provided by the embodiment of the present application includes:

S101: Acquire image information of a current encoding block and image information of adjacent encoding blocks, where the adjacent encoding blocks are encoded or decoded and reconstructed encoding blocks.

Wherein, the terminal device divides the video data into several frames of images, each frame of image includes several coding blocks, and the adjacent coding block is adjacent to the current coding block and is located on the left or above the current coding block. The adjacent coded block is a coded block that is coded or decoded and reconstructed using any intra-frame prediction method, and the image information is the pixel information of the coded block.

S102: Calculate at least one first prediction value of the neighboring coding block for intra prediction of the current coding block according to the image information of the neighboring coding block and at least one preset intra prediction mode, where each The first prediction values correspond to one intra prediction mode.

Among them, the intra prediction mode can be an existing intra prediction mode, for example, Planar mode, DC mode, horizontal mode, vertical mode, diagonal mode, etc., or it can be based on a dictionary learning algorithm and existing intra prediction The intra-frame prediction mode formed by the dictionary base generated by the mode, and each intra-frame prediction mode predicts the image according to the preset texture. In each intra-frame prediction mode, the current coding block is predicted by the adjacent coding block, and a first prediction value is obtained.

S103: Construct a mode matrix according to the at least one first predicted value.

Specifically, the mode matrix includes at least one first predicted value, and each first predicted value corresponds to an index identifier.

S104: Determine at least one mode combination according to the mode matrix and the preset algorithm, and calculate the intra-frame prediction of the current coding block by the neighboring coding block according to the image information of the neighboring coding block and the mode combination At least one second predicted value, wherein each second predicted value corresponds to a mode combination, and each mode combination includes at least one first predicted value and a weight coefficient corresponding to each first predicted value.

Specifically, at least one first predicted value is selected from the mode matrix according to a preset algorithm, and a weight coefficient corresponding to the first predicted value is generated to form a mode combination. When calculating the prediction method corresponding to the mode combination, adjacent coded blocks The second predicted value for the current coding block.

In a possible implementation manner, the second predicted value is calculated from the first predicted value and the weight coefficient corresponding to the mode combination, that is, the mode combination is an intra prediction method based on combined weighting. In particular, by the equation _{X '= Σ i = 1-} N ω i M i calculates a second prediction value, where, [omega] _i and M _i denote the i-th first prediction value corresponding to the intra prediction modes and the corresponding Weight coefficient. X'represents the second predicted value, N represents the number of first predicted values in the mode matrix, the weight coefficient corresponding to the first predicted value included in the mode combination is not 0, and the weight coefficients corresponding to the remaining first predicted values in the mode matrix Is 0.

In a possible implementation manner, a limitation condition is preset, and the limitation condition includes the number range of the first predicted value and/or the value range of the weight coefficient in the mode combination. For example, the number of first predicted values in the set mode combination is less than 5, the value range of the weight coefficient is -0.28-1, and the candidate coefficient retains two significant digits.

S105: Obtain the true value of the current encoding block according to the image information of the current encoding block, and use the second predicted value with the smallest difference from the true value as the prediction result of the current encoding block.

In a possible implementation, the difference between the second predicted value and the real value of the video data is calculated by the formula E=arg min||X'-X|| ² , where X represents the real value of the video data, E represents the difference between the second predicted value and the real value of the video data.

Wherein, the optimization algorithm may be an orthogonal matching pursuit algorithm, and the orthogonal matching algorithm is used to calculate the second predicted value with the smallest difference from the real value of the video data. Among them, the orthogonal matching pursuit algorithm is an existing technology, and will not be repeated here.

In the above-mentioned embodiment, by acquiring the image information of the current encoding block and the image information of the adjacent encoding block, the adjacent encoding block is calculated based on the image information of the adjacent encoding block and at least one preset intra prediction mode. At least one first predicted value of the intra-frame prediction, a mode matrix is constructed according to the at least one first predicted value, at least one mode combination is determined according to the mode matrix and a preset algorithm, and the true value of the current coding block is obtained according to the image information of the current coding block, The second predicted value with the smallest difference from the true value is used as the prediction result of the current coding block, that is, the intra-frame prediction method based on combined weighting can save bit rate and improve coding performance in video coding.

Corresponding to the video processing method described in the above embodiment, FIG. 2 shows a structural block diagram of an intra prediction apparatus provided in an embodiment of the present application. For ease of description, only parts related to the embodiment of the present application are shown.

As shown in Figure 2, the intra prediction device includes:

The first obtaining module 21 is configured to obtain image information of a current coding block and image information of adjacent coding blocks, where the adjacent coding blocks are coded or decoded and reconstructed coding blocks;

The first calculation module 22 is configured to calculate, according to the image information of the neighboring coding block and at least one preset intra prediction mode, at least one first step of the neighboring coding block for intra prediction of the current coding block. Predicted value, where each first predicted value corresponds to an intra-frame prediction mode;

The construction module 23 is configured to construct a mode matrix according to the at least one first predicted value;

The first determining module 24 is configured to determine at least one mode combination according to the mode matrix and a preset algorithm, and calculate the current coding of the adjacent coding block according to the image information of the adjacent coding block and the mode combination At least one second predicted value for intra-frame prediction of the block, where each second predicted value corresponds to a mode combination, and each mode combination includes at least one first predicted value and a weight coefficient corresponding to each first predicted value;

The prediction module 25 is configured to obtain the real value of the current coding block according to the image information of the current coding block, and use the second predicted value with the smallest difference from the real value as the prediction result of the current coding block.

In a possible implementation manner, the second predicted value is calculated from the first predicted value and the weight coefficient corresponding to the mode combination.

In a possible implementation manner, the preset algorithm includes an optimization algorithm and a restriction condition, and the restriction condition includes a quantity range of the first predicted value in the mode combination and/or a value range of the weight coefficient .

It should be noted that the information exchange and execution process among the above-mentioned devices/units are based on the same concept as the embodiment of the intra prediction method of this application. For specific functions and technical effects, please refer to the method The embodiment part will not be repeated here.

As shown in FIG. 3, a schematic diagram of a video processing system provided by an embodiment of this application. The video processing system includes a video encoder 31 and a video decoder 32. The intra-frame prediction method provided by the foregoing embodiment is applied to the video of the video encoder 31. The encoding process and the video decoding process of the video decoder 32.

As shown in FIG. 4, the video encoding method provided by the embodiment of the present application includes:

S401: Acquire image information of a current encoding block and image information of adjacent encoding blocks, where the adjacent encoding block is an encoded and reconstructed encoding block.

Wherein, after the terminal device obtains the video data, it first divides the video data into a number of frames of images, each frame of image includes a number of coding blocks, and adjacent coding blocks are located on the left or above the current coding block and adjacent to the current coding block. The adjacent coded blocks are coded blocks that are coded and reconstructed using any intra-frame prediction method.

S402: Perform intra-frame prediction on the current coding block according to the image information of the adjacent coding blocks and at least two prediction strategies, calculate the rate-distortion cost value of each prediction strategy, and use the prediction strategy with the least rate-distortion cost value as The target prediction strategy, wherein the at least two prediction strategies include a first prediction strategy and a second prediction strategy, and the first prediction strategy is the aforementioned intra-frame prediction method.

Specifically, the predicted value of the first prediction strategy is the second predicted value with the smallest difference from the true value obtained by using the intra-frame prediction method, and the first prediction strategy is the second predicted value with the smallest difference from the true value. The corresponding mode combination includes at least one first predicted value and a corresponding weight coefficient. The second prediction strategy is a traditional intra-frame prediction method, including an intra-frame prediction method. For example, it may be the intra-frame prediction method corresponding to the above-mentioned first prediction value. The rate-distortion cost value is a variable that characterizes the prediction residuals and the number of bits of the residual coding corresponding to the prediction residuals. The prediction strategy with the least cost-effective rate-distortion is used as the target prediction strategy to reduce the bit rate of residual coding and improve coding performance .

S403: Calculate a third prediction value for performing intra-frame prediction of the current coding block by the target prediction strategy.

In a possible implementation manner, the mode combination corresponding to the second predicted value with the smallest difference between the real value is used as the first prediction strategy, that is, the intra prediction method based on combined weighting, will be the first prediction with the smallest difference from the real value The intra prediction method corresponding to the value is used as the second prediction strategy, the rate-distortion cost values of the first prediction strategy and the second prediction strategy are calculated, and the prediction value corresponding to the prediction strategy with the smallest rate-distortion cost value is selected as the third prediction value.

S404: Obtain the real value of the current coding block according to the image information of the current coding block, and calculate a prediction residual according to the real value and the third predicted value.

Wherein, the prediction residual is the difference between the third prediction value and the real value of the current coding block.

S405: Perform coding according to the target prediction strategy and the prediction residual, and generate a video code stream according to the coding result.

In a possible implementation manner, the encoding method is a binary encoding method. If the target prediction strategy is the first prediction strategy, the strategy identifier corresponding to the first prediction strategy and the strategy corresponding to the first prediction strategy are The index identifier of the first prediction value, the weight coefficient corresponding to the first prediction strategy, and the prediction residual are encoded. If the target prediction strategy is the second prediction strategy, the strategy identifier corresponding to the second prediction strategy, the index identifier of the first prediction value corresponding to the first prediction strategy, and the prediction residual are encoded.

For example, if the target prediction strategy is the first prediction strategy, the strategy identifier is 1, and if the target prediction strategy is the second prediction strategy, the strategy identifier is 0. If the number of the first predicted value is 35, the binary number corresponding to 0-34 is used to encode the index identifier. If the value range of the weight coefficient is -0.28-1, the weight coefficient is transformed so that -0.28-1 corresponds to 0-127 one-to-one, and the binary number corresponding to 0-127 is used to encode the weight coefficient. Each coding block adopts the same coding method, which can generate the corresponding output code stream from the input video data.

In order to better introduce the video encoding method provided in this embodiment, the encoding process of a video encoder is taken as an example to describe the video encoding method provided in this embodiment.

As shown in Figure 5, the video data to be processed is input to the video encoder, and the video encoder executes the traditional intra-frame prediction method and the intra-frame prediction method based on combined weighting respectively, and predicts the current coding block according to the neighboring coding blocks. First, obtain the mode combination corresponding to the second predicted value with the smallest difference between the real value from the mode matrix, that is, the intra prediction method based on combined weighting, and then calculate the combined weighted intra prediction method and the traditional intra prediction method. Rate-distortion cost value, the prediction method with the smallest cost-distortion cost value is used as the target prediction strategy, and the first prediction strategy corresponding to the target prediction strategy corresponds to the strategy identification corresponding to the first prediction strategy, the index identification of the first prediction value corresponding to the first prediction strategy, and the first prediction strategy. The weight coefficients and prediction residuals corresponding to the prediction strategy are coded to obtain the output code stream.

In the above embodiment, by acquiring the image information of the current coding block and the image information of the adjacent coding block, the current coding block is intra-predicted according to the image information of the adjacent coding block and at least two prediction strategies, and each prediction strategy is calculated. The rate-distortion cost value of, the prediction strategy with the smallest rate-distortion cost value is the target prediction strategy. That is, by calculating the rate-distortion cost value, in the traditional intra-frame prediction method and the intra-frame prediction method based on combined weighting, the optimal method is selected as the target prediction strategy to minimize the rate-distortion cost value corresponding to the target prediction strategy. Calculate the prediction residuals according to the real value and the third predicted value, encode according to the target prediction strategy and the prediction residuals, generate a video code stream according to the coding results, and perform the same processing on each coding block to realize the coding processing of the video data , Improve coding performance.

Corresponding to the video encoding method described in the above embodiments, FIG. 6 shows a structural block diagram of a video encoding device provided in an embodiment of the present application. For ease of description, only parts related to the embodiment of the present application are shown.

As shown in Figure 6, the video encoding device includes:

The second acquiring module 61 is configured to acquire image information of the current encoding block and image information of adjacent encoding blocks, where the adjacent encoding blocks are encoded and reconstructed encoding blocks;

The second determining module 62 is configured to perform intra-frame prediction on the current coding block according to the image information of the adjacent coding block and at least two prediction strategies, calculate the rate-distortion cost value of each prediction strategy, and replace the rate-distortion The prediction strategy with the least value is used as the target prediction strategy, wherein the at least two prediction strategies include a first prediction strategy and a second prediction strategy, and the first prediction strategy is the frame according to any one of claims 1-3. Intra-prediction method;

The second calculation module 63 is configured to calculate a third prediction value for performing intra-frame prediction of the current coding block by the target prediction strategy;

The third calculation module 64 is configured to obtain the true value of the current encoding block according to the image information of the current encoding block, and calculate a prediction residual according to the true value and the third predicted value;

The encoding module 65 is used for encoding according to the target prediction strategy and the prediction residual, and generating a video code stream according to the encoding result.

In a possible implementation manner, the encoding module 65 is specifically configured to: if the target prediction strategy is the first prediction strategy, identify the strategy identifier corresponding to the first prediction strategy and the first prediction strategy The index identifier of the corresponding first prediction value, the weight coefficient corresponding to the first prediction strategy, and the prediction residual are encoded.

It should be noted that the information interaction and execution process between the above-mentioned devices/units are based on the same concept as the embodiment of the video coding method of this application, and their specific functions and technical effects can be found in video coding. The embodiment part of the method will not be repeated here.

As shown in FIG. 7, the video decoding method provided by the embodiment of the present application includes:

S701: Obtain a video code stream.

Specifically, the video code stream is an output code stream generated after being encoded by a video encoder.

S702: Decode the video code stream to obtain a strategy identifier and a prediction residual.

Specifically, after obtaining the video code stream, the video decoder decodes the encoding corresponding to the policy identifier and the encoding performed on the prediction residual according to the encoding rules of the video encoder, and restores the data before encoding.

S703: Determine a target prediction strategy from at least two prediction strategies according to the strategy identifier, the at least two prediction strategies including a first prediction strategy and a second prediction strategy, and the first prediction strategy is the aforementioned intra prediction method .

In a possible implementation, firstly determine whether it is the first prediction strategy or the second prediction strategy according to the strategy identifier obtained after decoding. The first prediction strategy is an intra prediction method based on combined weighting, and the second prediction strategy is a traditional prediction strategy. The intra-frame prediction method. For example, if the strategy identification is 1, it means that the target prediction strategy is the first prediction strategy, and if the strategy identification is 0, it means that the target prediction strategy is the second prediction strategy.

S704: Perform video reconstruction according to the target prediction strategy and the prediction residual.

In a possible implementation manner, if the target prediction strategy is the first prediction strategy, the video code stream is further decoded to obtain the index identification of the first prediction value corresponding to the first prediction strategy and the weight coefficient corresponding to the first prediction strategy; Perform video reconstruction according to the index identifier of the first prediction value corresponding to the first prediction strategy, the weight coefficient corresponding to the first prediction strategy, and the prediction residual.

In another possible implementation manner, if the target prediction strategy is the second prediction strategy, the video code stream is further decoded to obtain the index identification of the first prediction value corresponding to the first prediction strategy; according to the first prediction strategy corresponding to the first prediction strategy A prediction value index identification and prediction residuals are used for video reconstruction.

In order to better introduce the video decoding method provided in this embodiment, the decoding process of a video decoder is taken as an example to describe the video decoding method provided in this embodiment.

As shown in Figure 8, the encoded video stream is input to the video encoder. The video decoder first decodes according to the strategy identifier, and determines whether the target prediction strategy is a traditional intra-frame prediction method or a combined-weighted intra-frame based on the strategy identifier. method of prediction. After the target prediction strategy is determined, the code corresponding to the target prediction strategy is further decoded. If the target prediction strategy is an intra prediction method based on combined weighting, the index identification of the first prediction value and the weight corresponding to the first prediction strategy are obtained by decoding Coefficient; if the target prediction strategy is a traditional intra-frame prediction method, the index identifier of the first predicted value is obtained by decoding. According to the decoded target prediction strategy and the decoded prediction residual, the video can be reconstructed and the original video data can be restored.

In the above embodiment, the input code stream is acquired and the input code stream is decoded to obtain the strategy identifier and the prediction residual; according to the strategy identifier, it is determined whether the target prediction strategy is a traditional intra prediction method or a combined weighted intra prediction method, After determining the target prediction strategy, the target prediction strategy is further decoded, and the video is reconstructed according to the decoded target prediction strategy and the prediction residual.

It should be understood that the size of the sequence number of each step in the foregoing embodiments does not mean the order of execution. The execution sequence of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of the present application. .

Corresponding to the video decoding method described in the above embodiment, FIG. 9 shows a structural block diagram of a video decoding device provided in an embodiment of the present application. For ease of description, only parts related to the embodiment of the present application are shown.

As shown in Figure 9, the video decoding device includes:

The third obtaining module 91 is used to obtain a video code stream;

The decoding module 92 is configured to decode the video code stream to obtain a strategy identifier and a prediction residual;

The third determining module 93 is configured to determine a target prediction strategy from at least two prediction strategies according to the strategy identifier, the at least two prediction strategies including a first prediction strategy and a second prediction strategy, and the first prediction strategy is The above-mentioned intra-frame prediction method;

The video reconstruction module 94 is configured to perform video reconstruction according to the target prediction strategy and the prediction residual.

In a possible implementation manner, the video reconstruction module 94 is specifically configured to: if the target prediction strategy is the first prediction strategy, further decode the video code stream to obtain the corresponding first prediction strategy According to the index identifier of the first prediction value corresponding to the first prediction strategy, the weight coefficient corresponding to the first prediction strategy; the index identifier of the first prediction value corresponding to the first prediction strategy, the weight coefficient corresponding to the first prediction strategy, and the The prediction residual is used for video reconstruction.

It should be noted that the information exchange and execution process between the above-mentioned devices/units are based on the same concept as the method embodiments of this application, and their specific functions and technical effects can be found in the embodiments of the video decoding method. Part, I won’t repeat it here.

FIG. 10 is a schematic diagram of a terminal device provided by an embodiment of the present application. As shown in FIG. 10, the terminal device of this embodiment includes: a processor 101, a memory 102, and a computer program 103 that is stored in the memory 102 and can run on the processor 101. When the processor 101 executes the computer program 103, the steps in the above embodiment of the intra prediction method are implemented, for example, steps S101 to S105 shown in FIG. 1. Alternatively, when the processor 101 executes the computer program 103, the function of each module/unit in the embodiment of the intra prediction apparatus described above, for example, the function of the modules 21 to 25 shown in FIG. 2 is realized.

Exemplarily, the computer program 103 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 102 and executed by the processor 101 to complete This application. The one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 103 in the terminal device.

The terminal device may be a computing device such as a desktop computer, a notebook, a palmtop computer, and a cloud server. Those skilled in the art can understand that FIG. 10 is only an example of a terminal device, and does not constitute a limitation on the terminal device. It may include more or less components than those shown in the figure, or a combination of certain components, or different components, such as The terminal device may also include input and output devices, network access devices, buses, and so on.

The processor 101 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 102 may be an internal storage unit of the terminal device, such as a hard disk or memory of the terminal device. The memory 102 may also be an external storage device of the terminal device, for example, a plug-in hard disk equipped on the terminal device, a smart memory card (Smart Media Card, SMC), or a Secure Digital (SD) card, Flash Card, etc. Further, the memory 102 may also include both an internal storage unit of the terminal device and an external storage device. The memory 102 is used to store the computer program and other programs and data required by the terminal device. The memory 102 can also be used to temporarily store data that has been output or will be output.

Fig. 11 is a schematic diagram of a video encoder provided by an embodiment of the present application. As shown in FIG. 11, the video encoder of this embodiment includes: a processor 111, a memory 112, and a computer program 113 stored in the memory 112 and running on the processor 111. When the processor 111 executes the computer program 113, the steps in the foregoing embodiment of the video encoding method are implemented, for example, steps S401 to S405 shown in FIG. 4. Alternatively, when the processor 111 executes the computer program 113, the functions of the modules/units in the foregoing embodiment of the video encoding device are implemented, for example, the functions of the modules 61 to 65 shown in FIG. 6.

Exemplarily, the computer program 113 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 112 and executed by the processor 111 to complete This application. The one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 113 in the video encoder.

Those skilled in the art can understand that FIG. 11 is only an example of a video encoder, and does not constitute a limitation on the video encoder. It may include more or fewer components than those shown in the figure, or a combination of certain components, or different components. For example, the video encoder may also include input and output devices, network access devices, buses, and so on.

The processor 111 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 112 may be an internal storage unit of the video encoder, such as a hard disk or a memory of the video encoder. The memory 112 may also be an external storage device of the video encoder, such as a plug-in hard disk equipped on the video encoder, a smart media card (SMC), or a secure digital (SD) Card, Flash Card, etc. Further, the memory 112 may also include both an internal storage unit of the video encoder and an external storage device. The memory 112 is used to store the computer program and other programs and data required by the video encoder. The memory 112 may also be used to temporarily store data that has been output or will be output.

Fig. 12 is a schematic diagram of a video decoder provided by an embodiment of the present application. As shown in FIG. 12, the video decoder of this embodiment includes: a processor 121, a memory 122, and a computer program 123 stored in the memory 122 and running on the processor 121. When the processor 121 executes the computer program 123, the steps in the foregoing embodiment of the video processing method are implemented, for example, steps S701 to S704 of the video decoding method shown in FIG. 7. Alternatively, when the processor 121 executes the computer program 123, the functions of the modules/units in the foregoing embodiment of the video decoding apparatus are implemented, for example, the functions of the modules 91 to 94 shown in FIG. 9.

Exemplarily, the computer program 123 may be divided into one or more modules/units, and the one or more modules/units are stored in the memory 122 and executed by the processor 121 to complete This application. The one or more modules/units may be a series of computer program instruction segments capable of completing specific functions, and the instruction segments are used to describe the execution process of the computer program 123 in the video decoder.

Those skilled in the art can understand that FIG. 12 is only an example of a video decoder, and does not constitute a limitation on the video decoder. It may include more or fewer components than those shown in the figure, or a combination of certain components, or different components. For example, the video decoder may also include input and output devices, network access devices, buses, and so on.

The processor 121 may be a central processing unit (Central Processing Unit, CPU), other general-purpose processors, digital signal processors (Digital Signal Processor, DSP), application specific integrated circuits (ASIC), Field-Programmable Gate Array (FPGA) or other programmable logic devices, discrete gates or transistor logic devices, discrete hardware components, etc. The general-purpose processor may be a microprocessor or the processor may also be any conventional processor or the like.

The memory 122 may be an internal storage unit of the video decoder, such as a hard disk or a memory of the video decoder. The memory 122 may also be an external storage device of the video decoder, such as a plug-in hard disk equipped on the video decoder, a smart memory card (Smart Media Card, SMC), or Secure Digital (SD). Card, Flash Card, etc. Further, the memory 122 may also include both an internal storage unit of the video decoder and an external storage device. The memory 122 is used to store the computer program and other programs and data required by the video decoder. The memory 122 can also be used to temporarily store data that has been output or will be output.

Those skilled in the art can clearly understand that, for the convenience and conciseness of description, only the division of the above functional units and modules is used as an example. In practical applications, the above functions can be allocated to different functional units and modules as needed. Module completion, that is, the internal structure of the device is divided into different functional units or modules to complete all or part of the functions described above. The functional units and modules in the embodiments can be integrated into one processing unit, or each unit can exist alone physically, or two or more units can be integrated into one unit. The above-mentioned integrated units can be hardware-based Formal realization can also be realized in the form of a software functional unit. In addition, the specific names of the functional units and modules are only for the convenience of distinguishing each other, and are not used to limit the protection scope of the present application.

In the above-mentioned embodiments, the description of each embodiment has its own focus. For parts that are not described in detail or recorded in an embodiment, reference may be made to related descriptions of other embodiments.

A person of ordinary skill in the art may realize that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be implemented by electronic hardware or a combination of computer software and electronic hardware. Whether these functions are executed by hardware or software depends on the specific application and design constraint conditions of the technical solution. Professionals and technicians can use different methods for each specific application to implement the described functions, but such implementation should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed device/terminal device and method may be implemented in other ways. For example, the device/terminal device embodiments described above are only illustrative. For example, the division of the modules or units is only a logical function division, and there may be other divisions in actual implementation, such as multiple units. Or components can be combined or integrated into another system, or some features can be omitted or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components displayed as units may or may not be physical units, that is, they may be located in one place, or they may be distributed on multiple network units. Some or all of the units may be selected according to actual needs to achieve the objectives of the solutions of the embodiments.

In addition, the functional units in the various embodiments of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above-mentioned integrated unit can be implemented in the form of hardware or software functional unit.

If the integrated module/unit is implemented in the form of a software functional unit and sold or used as an independent product, it can be stored in a computer readable storage medium. Based on this understanding, the present application implements all or part of the processes in the above-mentioned embodiments and methods, and can also be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium. When the program is executed by the processor, it can implement the steps of the foregoing method embodiments. Wherein, the computer program includes computer program code, and the computer program code may be in the form of source code, object code, executable file, or some intermediate forms. The computer-readable medium may include: any entity or device capable of carrying the computer program code, recording medium, U disk, mobile hard disk, magnetic disk, optical disk, computer memory, read-only memory (ROM, Read-Only Memory) , Random Access Memory (RAM, Random Access Memory), electrical carrier signal, telecommunications signal, and software distribution media, etc.

The above-mentioned embodiments are only used to illustrate the technical solutions of the present application, not to limit them; although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still implement the foregoing The technical solutions recorded in the examples are modified, or some of the technical features are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the application, and should be included in Within the scope of protection of this application.

Claims

An intra-frame prediction method is characterized in that it comprises:

Acquiring image information of the current encoding block and image information of adjacent encoding blocks, where the adjacent encoding blocks are encoded or decoded and reconstructed encoding blocks;

According to the image information of the adjacent coding block and at least one preset intra prediction mode, at least one first prediction value of the adjacent coding block for intra prediction of the current coding block is calculated, wherein each first prediction value is One prediction value corresponds to one intra prediction mode;

Constructing a mode matrix according to the at least one first predicted value;

At least one mode combination is determined according to the mode matrix and a preset algorithm, and at least one of the intra-frame prediction of the current coding block by the neighboring coding block is calculated according to the image information of the neighboring coding block and the mode combination The second prediction value, where each second prediction value corresponds to a mode combination, and each mode combination includes at least one first prediction value and a weight coefficient corresponding to each first prediction value;

Obtain the true value of the current encoding block according to the image information of the current encoding block, and use the second predicted value with the smallest difference from the true value as the prediction result of the current encoding block.
8. The intra-frame prediction method according to claim 1, wherein the second predicted value is calculated from the first predicted value and the weight coefficient corresponding to the mode combination.
The intra-frame prediction method according to claim 1, wherein the preset algorithm includes an optimization algorithm and a limited condition, and the limited condition includes the number range of the first predicted value in the mode combination and/or the The value range of the weight coefficient.
A video encoding method applied to a video encoder, characterized in that the video encoding method includes:

Acquiring image information of a current encoding block and image information of adjacent encoding blocks, where the adjacent encoding blocks are encoded and reconstructed encoding blocks;

Perform intra-frame prediction on the current coding block according to the image information of the adjacent coding block and at least two prediction strategies, calculate the rate-distortion cost value of each prediction strategy, and use the prediction strategy with the smallest rate-distortion cost value as the target prediction Strategy, wherein the at least two prediction strategies include a first prediction strategy and a second prediction strategy, and the first prediction strategy is the intra prediction method according to any one of claims 1-3;

Calculating a third prediction value for performing intra-frame prediction of the current coding block by the target prediction strategy;

Obtaining the real value of the current coding block according to the image information of the current coding block, and calculating a prediction residual according to the real value and the third predicted value;

Encoding is performed according to the target prediction strategy and the prediction residual, and a video code stream is generated according to the encoding result.
The video encoding method according to claim 4, wherein the encoding according to the target prediction strategy and the prediction residual specifically comprises:

If the target prediction strategy is the first prediction strategy, the strategy ID corresponding to the first prediction strategy, the index ID of the first prediction value corresponding to the first prediction strategy, and the index ID corresponding to the first prediction strategy are The weight coefficient and the prediction residual are encoded.
A video decoding method applied to a video decoder, characterized in that the video decoding method includes:

Obtain video stream;

Decoding the video code stream to obtain a strategy identifier and a prediction residual;

Determine a target prediction strategy from at least two prediction strategies according to the strategy identifier, the at least two prediction strategies including a first prediction strategy and a second prediction strategy, and the first prediction strategy is any one of claims 1-3 The intra-frame prediction method described in item;

Perform video reconstruction according to the target prediction strategy and the prediction residual.
8. The video decoding method according to claim 6, wherein said performing video reconstruction according to said target prediction strategy and said prediction residual comprises:

If the target prediction strategy is the first prediction strategy, the video code stream is further decoded to obtain the index identifier of the first prediction value corresponding to the first prediction strategy and the weight coefficient corresponding to the first prediction strategy ；

Perform video reconstruction according to the index identifier of the first prediction value corresponding to the first prediction strategy, the weight coefficient corresponding to the first prediction strategy, and the prediction residual.
An intra-frame prediction device is characterized in that it comprises:

The first acquisition module is configured to acquire image information of the current encoding block and image information of adjacent encoding blocks, where the adjacent encoding blocks are encoded or decoded and reconstructed encoding blocks;

The first calculation module is configured to calculate at least one first prediction of intra prediction of the current coding block by the neighboring coding block according to the image information of the neighboring coding block and at least one preset intra prediction mode Value, where each first prediction value corresponds to an intra prediction mode;

A construction module, configured to construct a mode matrix according to the at least one first predicted value;

The first determining module is configured to determine at least one mode combination according to the mode matrix and a preset algorithm, and calculate the comparison between the adjacent coding block and the current coding block according to the image information of the adjacent coding block and the mode combination At least one second predicted value for intra-frame prediction, where each second predicted value corresponds to a mode combination, and each mode combination includes at least one first predicted value and a weight coefficient corresponding to each first predicted value;

The prediction module is configured to obtain the real value of the current coding block according to the image information of the current coding block, and use the second predicted value with the smallest difference from the real value as the prediction result of the current coding block.
A video encoding device, characterized in that it comprises:

The second acquiring module is configured to acquire the image information of the current encoding block and the image information of the adjacent encoding block, wherein the adjacent encoding block is an encoded and reconstructed encoding block;

The second determining module is configured to perform intra-frame prediction on the current coding block according to the image information of the adjacent coding block and at least two prediction strategies, calculate the rate-distortion cost value of each prediction strategy, and replace the rate-distortion cost value The smallest prediction strategy is used as the target prediction strategy, wherein the at least two prediction strategies include a first prediction strategy and a second prediction strategy, and the first prediction strategy is the intraframe according to any one of claims 1 to 3 method of prediction;

A second calculation module, configured to calculate a third prediction value for intra-frame prediction of the current coding block by the target prediction strategy;

A third calculation module, configured to obtain the true value of the current encoding block according to the image information of the current encoding block, and calculate a prediction residual according to the true value and the third predicted value;

The encoding module is used for encoding according to the target prediction strategy and the prediction residual, and generating a video code stream according to the encoding result.
A video decoding device, characterized in that it comprises:

The third acquisition module is used to acquire the video code stream;

The decoding module is used to decode the video code stream to obtain a strategy identifier and a prediction residual;

The third determining module is configured to determine a target prediction strategy from at least two prediction strategies according to the strategy identifier, the at least two prediction strategies including a first prediction strategy and a second prediction strategy, and the first prediction strategy is as The intra-frame prediction method according to any one of claims 1-3;

The video reconstruction module is configured to perform video reconstruction according to the target prediction strategy and the prediction residual.
A terminal device, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program as claimed in claims 1 to 3. The method of any one of.
A video encoder, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program as claimed in claim 4 To the method of any one of 5.
A video decoder, comprising a memory, a processor, and a computer program stored in the memory and running on the processor, wherein the processor executes the computer program as claimed in claim 6 To the method of any one of 7.
A video processing system, comprising the video encoder according to claim 12 and the video decoder according to claim 13.
A computer-readable storage medium, wherein the computer-readable storage medium stores a computer program, wherein when the computer program is executed by a processor, it realizes any one of claims 1 to 3 or 4 to 5 or 6 to 7. The method described in the item.