TWI694713B - Method and apparatus for processing video data - Google Patents

Abstract

The embodiment of the present invention provides a method and apparatus for processing video data, which relate to the field of data processing. The method includes: determining whether the information of the current coding unit satisfies the coding and decoding condition of the sub coding unit; if the information of the current coding unit satisfies the coding and decoding condition of the sub coding unit, acquiring motion information of each of the at least two sub coding units, and determining a first candidate motion information list of the current coding unit according to the motion information of each of the at least two sub coding units; and obtaining prediction information of the current coding unit according to the first candidate motion information list; wherein the at least two sub-coding units are sub-coding unit obtained after dividing the current coding unit, and the first candidate motion information list includes motion information of each of the at least two sub-coding units and candidate motion information of the current coding unit.

Description

Method and device for processing video data

Embodiments of the present invention relate to the field of data processing, and in particular, to a method and device for processing video data.

With the development of information technology, video data has increasingly become the main way for users to obtain information in daily life. Generally, the amount of video data is relatively large (especially high-definition video, etc.). In order to reduce the storage space occupied by video data, In addition, the transmission bandwidth occupied during the transmission of video data can be reduced. The video data can be compressed and stored or transmitted. When the video data is played, the video data can be decoded and played again.

At present, in the process of encoding and decoding video materials, the encoding and decoding of video materials are two reciprocal processes. Taking the encoding of video materials as an example, in an encoding method, the encoding unit can be used to encode the video data. Encode every frame. Specifically, a video frame (that is, an image) is divided into at least two image blocks (each image block may be called a coding unit), and then for each coding unit, the motion information of the coding unit is determined , And determine the prediction value of the coding unit (that is, the primitive value of the coding unit) according to the motion information of the coding unit, and the prediction information of the coding unit, and encode the coding unit. All coding units of a video frame are coded according to the method described above, thereby completing coding of the video material. In another coding method, since the above coding method based on coding units, all the primitive values in one coding unit use the same motion information, and in this coding unit, not all primitive values may have For the same motion information, in this case, one coding unit can be subdivided into at least two sub-coding units, and then sub-coding unit based motion vector prediction (SMVP) technology and decoding end are used. Decoder motion vector derivation (DMVD) technology, or non-translational motion model, obtains the motion information of each sub-coding unit of the coding unit, and further determines each one according to the motion information of each sub-coding unit The prediction value of the sub-coding unit, thereby obtaining the prediction value of the coding unit, and finally coding the coding unit according to the prediction value of the coding unit. In this way, the video recording device performs the above method on all coding units of each video frame of the video material Encoding to complete the encoding of the video material.

However, in the above method, when the size of the coding unit is small, it may not be necessary to divide the coding unit into sub-coding units for encoding or decoding, but the video recording device still divides the coding unit into sub-coding units and encodes the sub-coding units Or decoding, to complete the coding and decoding of the coding unit, which may lead to more complicated coding and decoding of video materials.

The present application provides a method and device for processing video data, which can reduce the complexity of video data encoding and decoding.

In order to achieve the above purpose, this application adopts the following technical solutions:

In the first aspect, the present application provides a method for processing video data. The method may include: determining whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit; if the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, obtain The respective motion information of at least two sub-coding units; and according to the respective motion information of the at least two sub-coding units, determine the first candidate motion information list of the current coding unit, and obtain the current coding unit according to the first candidate motion information list Forecast information. Wherein, the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit includes that the information of the current coding unit satisfies at least one of the following conditions:

The size information of the current coding unit meets the coding and decoding size conditions of the sub-coding unit;

The prediction information of at least one coding unit adjacent to the current coding unit is obtained according to the motion information of the sub-coding units of the adjacent coding unit.

The current coding unit includes a coding block. The coding block includes an image block in the first video frame. At least two sub-coding units are sub-coding units obtained by dividing the current coding unit. The sub-coding unit includes a sub-coding block. The first The candidate motion information list includes motion information of each of the at least two sub-coding units and candidate motion information of the current coding unit.

The method for processing video data provided by this application can determine whether to divide the current coding unit into sub-coding units for encoding or decoding according to the actual conditions of the current coding unit according to whether the information of the current coding unit satisfies the coding and decoding conditions of the sub coding unit, When the size of the current coding unit is small, there is no need to divide the current coding unit into sub-coding units, and then encode or decode. Therefore, the complexity of encoding and decoding of video materials can be reduced.

In a first optional implementation manner of the first aspect, the method for processing video data provided by the present application may be applied to a decoding device. The above method for obtaining prediction information of a current coding unit according to the first candidate motion information list may include: : Acquire instruction information for indicating the first target candidate sports information in the first candidate sports information list, and determine the first target candidate sports information based on the first candidate sports information list and the indication information of the first target candidate sports information, And according to the first target candidate motion information, the prediction information of the current coding unit is determined.

In the present application, after the decoding device obtains the first candidate motion information list, the decoding device may obtain indication information of the first target candidate motion information from the code stream of the current coding unit it receives, so that the decoding device may use the first candidate The sports information list and the indication information of the first target candidate sports information accurately determine the first target candidate sports information.

In a second optional implementation manner of the first aspect, the method for processing video data provided by the present application may be applied to a decoding device. If the information of the current encoding unit does not satisfy the encoding and decoding conditions of the sub-encoding unit, the The method for processing video data may further include: determining a second candidate motion information list of the current coding unit, and acquiring indication information for indicating the second target candidate motion information in the second candidate motion information list, and according to the second candidate motion The information list and the indication information of the second target candidate motion information determine the second target candidate motion information, and finally determine the prediction information of the current coding unit according to the second target candidate motion information. The second candidate motion information list includes the current coding unit's The candidate motion information does not include motion information of at least two sub-coding units.

In this application, when the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, there is no need to obtain the motion information of at least two sub-coding units (that is, there is no need to divide the current coding unit into sub-coding units). The prediction information of the current coding unit can be directly determined according to the second target candidate motion information in the second candidate motion information list, so that the complexity of video data encoding and decoding can be reduced.

In a second optional implementation manner of the first aspect, the method for processing video data provided by the present application may be applied to a decoding device, and the method may further include: the decoding device decodes the code stream after receiving the current encoding unit encoding To obtain the first residual information, and determine the reconstruction information of the current coding unit based on the prediction information of the current coding unit and the first residual information.

In this application, the decoding device determines the reconstruction information of the current coding unit based on the prediction information of the current coding unit and the first residual information, that is, the decoding device can obtain the complete information of the current coding unit, and then the decoding device can determine all the coding units by Reconstruction information, get the complete information of the video data to be decoded, so that the decoding device can play the video data smoothly.

In a fourth optional implementation manner of the first aspect, the method for processing video data provided by the present application may be applied to an encoding device. The above method for obtaining prediction information of the current encoding unit according to the first candidate motion information list may include: : Determine the first target candidate motion information in the first candidate motion information list, and determine the prediction information of the current coding unit according to the first target candidate motion information.

In this application, the coding device can determine the candidate motion information list of the current coding unit according to the motion information of at least two sub-coding units and combine the motion information of the current coding unit, and then use rate distortion optimization technology to select from the candidate motion information list Determining the optimal operating information, thereby determining the prediction information of the current coding unit according to the optimal motion information, can make the determined prediction information of the current coding unit more accurate.

In a fifth optional implementation manner of the first aspect, the method for processing video data provided by the present application may be applied to an encoding device. If the information of the current encoding unit does not satisfy the encoding and decoding conditions of the sub-encoding unit, the processing provided by the present application The video data method may further include: determining a second candidate motion information list of the current coding unit, and determining second target candidate motion information in the second candidate motion information list, and determining the current coding unit based on the second target candidate motion information The prediction information of the second candidate motion information list includes candidate motion information of the current coding unit, but does not include motion information of at least two sub-coding units.

In this application, when the information of the current coding unit does not meet the coding and decoding conditions of the sub-coding unit, it is not necessary to obtain the motion information of at least two sub-coding units (that is, there is no need to divide the current coding unit into sub-coding units) and encode The device can directly determine the prediction information of the current coding unit based on the second target candidate motion information in the second candidate motion information list (the second target candidate motion information is the candidate motion information of the current coding unit), so that the video data can be reduced Codec complexity.

In a sixth optional implementation manner of the first aspect, the method for processing video data provided by the present application may be applied to an encoding device, and the method may further include: incorporating indication information for indicating target candidate motion information into the current encoding The code stream of the unit.

In the present application, after the encoding device finishes encoding the current encoding unit, the encoding device may encode the indication information of the first target candidate motion information or the second target candidate motion information it determines into the code stream. When receiving the code stream encoded by the current coding unit, the decoding device may obtain the indication information of the first target candidate motion information or the second target candidate motion information of the current coding unit from the code stream.

In a seventh optional implementation manner of the first aspect, the method for processing video data provided in this application may be applied to an encoding device. The method may include: the encoding device obtains the original information of the current encoding unit, and according to the current encoding unit Prediction information and the original information of the current coding unit, encoding the current coding unit.

In this application, according to the prediction information of the current coding unit and the original information of the current coding unit, the current coding unit is coded, and then the coding device can obtain the encoded video data by coding all the coding units. The video data is compressed so that when the video data is stored, there is no need to occupy a large storage space. When the encoding device sends the video data to other devices, there is no need to occupy a large transmission bandwidth. Thus, encoding the video data is beneficial to the video Data storage and fast transmission.

In a second aspect, the present application provides a method for processing video data. The method may include: determining whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, and if the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, obtain at least The motion information of the two sub-coding units, at least two sub-coding units are sub-coding units obtained by dividing the current coding unit, and the prediction information of the current coding unit is obtained according to the motion information of the at least two sub-coding units.

Wherein, the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit includes that the information of the current coding unit satisfies at least one of the following conditions:

The size information of the current coding unit meets the coding and decoding size conditions of the sub-coding unit;

The prediction information of at least one coding unit adjacent to the current coding unit is obtained according to the motion information of the sub-coding units of the adjacent coding unit.

The method for processing video data provided by this application can determine whether the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, and determines whether to divide the current coding unit into sub-coding units for coding and decoding according to the actual situation of the current coding unit, When the size of the current coding unit is small, there is no need to divide the current coding unit into sub-coding units and then perform coding and decoding. Therefore, the complexity of video data coding and decoding can be reduced.

In a first optional implementation manner of the second aspect, the foregoing method for acquiring motion information of at least two sub-coding units may include: acquiring motion information of a current coding unit, and using the motion information of the current coding unit as Each initial motion information of at least two sub-coding units performs a motion search, so as to obtain respective motion information of at least two sub-coding units.

In this application, a search algorithm can be used to determine the motion information of the current coding unit, and then determine the motion information of each of the at least two sub-coding units, so that the motion information of the at least two sub-coding units can be accurately determined.

In a second optional implementation manner of the second aspect, if the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the method of video data provided by the present application may further include: obtaining the motion information of the current coding unit, And according to the motion information of the current coding unit, the prediction information of the current coding unit is determined.

In this application, when the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, there is no need to obtain the motion information of at least two sub-coding units (that is, there is no need to divide the current coding unit into sub-coding units). The prediction information of the current coding unit can be directly determined according to the motion information of the current coding unit. In this way, the complexity of video data encoding and decoding can be reduced.

In a third optional implementation manner of the second aspect, the method for processing video data provided in this application may be applied to a decoding device, and the above method for acquiring motion information of at least two sub-coding units may include: acquiring a prediction mode Indication information, the value of the prediction mode indication information is used to indicate whether the prediction mode is an affine transformation mode, and if the value of the prediction mode indication information indicates that the current prediction mode is an affine transformation mode, at least two primitive positions of the current coding unit are obtained And the motion information of at least two sub-coding units according to the motion information of at least two picture element positions.

In this application, since the encoding device can encode the prediction mode indication information into the code stream of the current encoding unit, the decoding device can obtain the prediction mode indication information of the current encoding unit from the code stream after encoding the current encoding unit it receives, and according to The prediction mode indication information determines whether to use the affine transformation mode of the non-translational motion model to determine the prediction information of the current coding unit.

In a fourth optional implementation manner of the second aspect, the method for processing video data provided by the present application may be applied to an encoding device, and the above method for acquiring motion information of at least two sub-encoding units may include: acquiring the current encoding The motion information of at least two primitive positions of the unit, and according to the motion information of the at least two primitive positions, determine the respective motion information of the at least two sub-coding units.

In a fifth optional implementation manner of the second aspect, the method for processing video data provided in this application may be applied to an encoding device, and the method may further include: determining the prediction of the current coding unit according to the prediction information of the current coding unit Mode, and the prediction mode indication information is coded into the code stream of the current coding unit. The value of the prediction mode indication information is used to indicate whether the prediction mode is an affine transformation mode.

In this application, the encoding device encodes the prediction mode indication information of the current coding unit into the code stream of the current coding unit. Thus, after the decoding device receives the code stream of the current coding unit, the decoding device can learn the current coding unit according to the prediction mode indication information Whether the prediction mode of is the affine transformation mode.

In a sixth optional implementation manner of the second aspect, the method for processing video materials provided in this application may be applied to an encoding device. If the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the method for processing video data provided in this application may further include: determining the prediction information of the current coding unit according to the set of candidate prediction modes, which does not include the simulation Shot transformation mode.

In this application, since the non-translational motion model is only used to obtain the motion information of the sub-coding unit, if the information of the current coding unit does not meet the coding and decoding conditions of the sub-coding unit, the encoding device cannot use the method of the non-translational motion model To determine the motion information of the current coding unit, the coding device uses one of the methods in the set of candidate prediction modes to determine the prediction information of the current coding unit.

In terms of third-party vendors, this application provides a device for processing video data. The device may include a determination module and an acquisition module. Among them, the determination module can be used to determine whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit; the acquisition module can be used to determine whether the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, Acquiring motion information of each of the at least two sub-coding units; the determining module can also be used to determine the first candidate motion information list of the current coding unit based on the respective motion information of the at least two sub-coding units acquired by the acquiring module, and According to the first candidate motion information list, the prediction information of the current coding unit is obtained.

Wherein, the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit includes that the information of the current coding unit satisfies at least one of the following conditions:

The size information of the current coding unit meets the coding and decoding size conditions of the sub-coding unit;

The prediction information of at least one coding unit adjacent to the current coding unit is obtained according to the motion information of the sub-coding units of the adjacent coding unit.

The current coding unit includes a coding block. The coding block includes an image block in the first video frame. At least two sub-coding units are sub-coding units obtained by dividing the current coding unit. The sub-coding unit includes a sub-coding block. The first The candidate motion information list includes motion information of each of the at least two sub-coding units and candidate motion information of the current coding unit.

In a first optional implementation manner of a third-party vendor, the device for processing video data provided by this application may be a decoding device, and the above acquisition module may also be used to acquire The indication information of the first target candidate sports information; the above determination module is specifically used to determine the first target candidate sports information according to the first candidate motion information list and the indication information of the first target candidate sports information, and according to the first target candidate Motion information, to determine the prediction information of the current coding unit.

In a second optional implementation manner of a third-party vendor, the apparatus for processing video data provided by this application may be a decoding device, and the decoding device may further include a decoding module, which may be used to decode the received The code stream after the current coding unit is encoded to obtain the first residual information. The above determination module can also be used to determine the reconstruction information of the current coding unit according to the prediction information and the first residual information of the current coding unit.

In a third optional implementation of the third-party vendor, the device for processing video data provided in this application may be a decoding device, and the above-mentioned determination module may also be used when the information of the current coding unit does not satisfy the coding of the sub-coding unit. In the case of decoding conditions, determine the second candidate motion information list of the current coding unit; the above acquisition module can also be used to obtain indication information for indicating the second target candidate motion information in the second candidate motion information list; The determination module can also be used to determine the second target candidate motion information based on the second candidate motion information list and the indication information of the second target candidate motion information acquired by the acquisition module, and determine the current based on the second target candidate motion information For the prediction information of the coding unit, the second candidate motion information list includes candidate motion information of the current coding unit, but does not include motion information of at least two sub-coding units.

In a fourth optional implementation of the third-party vendor, the device for processing video data provided by this application may be an encoding device, and the above-mentioned determination module is specifically used in the first candidate sports information list acquired by the acquisition module The first target candidate motion information is determined, and based on the first target candidate motion information, the prediction information of the current coding unit is determined.

In a fifth optional implementation of the third-party vendor, the device for processing video data provided by this application may be an encoding device, and the above-mentioned determination module may also be used when the information of the current encoding unit does not satisfy the encoding of the sub-encoding unit. In the case of decoding conditions, determine the second candidate motion information list of the current coding unit, and determine the second target candidate motion information in the second candidate motion information list, and determine the prediction of the current coding unit based on the second target candidate motion information Information, the second candidate motion information list includes candidate motion information of the current coding unit, and does not include motion information of at least two sub-coding units.

In a sixth optional implementation manner of a third-party vendor, the device for processing video data provided by this application may be an encoding device, and the encoding device further includes an encoding module, and the encoding module may be used to indicate The indication information of the target candidate motion information or the indication information of the second target candidate motion information is incorporated into the code stream of the current coding unit.

In a sixth optional implementation manner of a third-party vendor, the device for processing video data provided by this application may be an encoding device, and the above acquiring module may also be used to acquire the original information of the current encoding unit; the above encoding module , Can also be used to encode the current coding unit based on the prediction information of the current coding unit and the original information of the current coding unit.

For the technical effects of the third-party vendor and various optional implementations thereof, reference may be made to the above related description of the technical effects of the first aspect and its various optional implementations, which will not be repeated here.

In a fourth aspect, the present application provides an apparatus for processing video data. The apparatus may include a determination module and an acquisition module. Among them, the determination module can be used to determine whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit; the acquisition module can be used to determine whether the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, Obtaining the motion information of at least two sub-coding units; the determination module can also be used to obtain the prediction information of the current coding unit according to the motion information of the at least two sub-coding units obtained by the obtaining module.

Wherein, the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit includes that the information of the current coding unit satisfies at least one of the following conditions:

The size information of the current coding unit meets the coding and decoding size conditions of the sub-coding unit;

The prediction information of at least one coding unit adjacent to the current coding unit is obtained according to the motion information of the sub-coding units of the adjacent coding unit.

The current coding unit includes a coding block, and the coding block includes one image block in the first video frame. At least two sub coding units are sub coding units obtained after the current coding unit is divided. The sub coding units include sub coding blocks.

In a first optional implementation manner of the fourth aspect, the above acquisition module is specifically configured to acquire the motion information of the current coding unit, and use the motion information of the current coding unit as the initial value of each of the at least two sub-coding units respectively The motion information is searched by motion, so as to obtain the motion information of at least two sub-coding units.

In a second optional implementation manner of the fourth aspect, the above acquiring module may also be used to acquire the motion information of the current encoding unit when the information of the current encoding unit does not satisfy the encoding and decoding conditions of the sub-encoding unit; The group can also be used to determine the prediction information of the current coding unit based on the motion information of the current coding unit acquired by the acquisition module.

In a third optional implementation manner of the fourth aspect, the apparatus for processing video data provided in this application may be a decoding device. The above acquisition module is specifically used to acquire prediction mode indication information, and indicate information in the prediction mode. The value indicates that when the current prediction mode is an affine transformation mode, the motion information of at least two primitive positions of the current coding unit is obtained, and according to the motion information of the at least two primitive positions, each of the at least two sub-coding units is determined Motion information. The value of the prediction mode indicator information is used to indicate whether the prediction mode is an affine transformation mode.

In a fourth optional implementation manner of the fourth aspect, the apparatus for processing video data provided by the present application may be an encoding device, and the above acquiring module is further used to acquire the motion of at least two picture element positions of the current encoding unit Information, and determine the motion information of at least two sub-coding units according to the motion information of at least two picture element positions.

In a fifth optional implementation manner of the fourth aspect, the apparatus for processing video data provided by the present application may be an encoding device, and the encoding device may further include an encoding module, and the above-mentioned determining module is also used for encoding according to the current encoding. The prediction information of the unit determines the prediction mode of the current coding unit; the coding module can be used to program the prediction mode indication information determined by the determination module into the code stream of the current coding unit, and the value of the prediction mode indication information is used to indicate the prediction mode Whether it is an affine transformation mode.

In a sixth optional implementation manner of the fourth aspect, the apparatus for processing video data provided by this application may be an encoding device; the above determination module may also be used when the information of the current encoding unit does not satisfy the encoding of the sub-encoding unit In the case of decoding conditions, the prediction information of the current coding unit is determined according to the set of candidate prediction modes, which does not include the affine transformation mode.

For the technical effects of the fourth aspect and various optional implementation manners thereof, reference may be made to the foregoing related description of the technical effects of the second aspect and various optional implementation manners, and details are not described herein again.

In the first aspect to the fourth aspect, the size information of the current coding unit satisfies the codec size condition of the sub-coding unit includes that the size information of the current coding unit satisfies any one of the following conditions:

The number of picture elements of the current coding unit is greater than or equal to the first threshold;

The ratio of the number of picture elements of the current coding unit to the number of picture elements of the first sub-coding unit is greater than or equal to the second threshold, and the first sub-coding unit is one of at least two sub-coding units;

The width of the current coding unit is greater than or equal to the third threshold, or the height of the current coding unit is greater than or equal to the fourth threshold.

In this application, the decoding device or the encoding device determines that the information of the current coding unit satisfies the above-mentioned encoding and decoding conditions of the sub-encoding unit, and the decoding device or the encoding device can determine to decode or encode the current encoding unit by dividing the current encoding unit into sub-encoding units , The above encoding and decoding conditions of the sub-encoding unit may include multiple types, so that the decoding device or encoding device may determine whether to divide the current encoding unit into sub-encoding units according to a variety of optional encoding and decoding conditions of the sub-encoding unit, and select an appropriate decoding method or The coding method completes the decoding or coding of the current coding unit.

In a fifth aspect, the present application provides an apparatus for processing video data. The apparatus may include a processor and a memory coupled to the processor. The memory is used to store computer instructions. When the device is running, the processor executes the computer instructions stored in the memory, so that the device executes any one of the first aspect and various optional implementations described above Method of processing video data.

In a sixth aspect, the present application provides a computer-readable storage medium that includes computer instructions, and when the computer instructions run on a device that processes video data, causes the device to perform the first aspect and its various The method for processing video materials described in any one of the selected implementation modes.

In a seventh aspect, the present application provides a computer program product containing instructions that, when the computer program product runs on a device that processes video data, causes the device to perform any of the first aspect and any of its various optional implementations. The method of processing video data described.

For descriptions of the related content and technical effects of the fifth aspect to the seventh aspect, reference may be made to the related descriptions of the related content and technical effects of the first aspect and its various optional implementation manners, and details are not described herein.

In an eighth aspect, the present application provides an apparatus for processing video data. The apparatus includes a processor and a memory coupled to the processor. The memory is used to store computer instructions. When the device for processing video data is running, the processor executes the computer instructions stored in the memory to cause the device to perform any one of the second aspect and various optional implementations thereof The method of processing video data.

In a ninth aspect, the present application provides a computer-readable storage medium, the computer-readable storage medium including computer instructions, when the computer instructions run on a device for processing video data, the device is allowed to perform the second aspect and various optional The method for processing video materials described in any one of the

According to a tenth aspect, the present application provides a computer program product containing instructions that, when the computer program product runs on a device that processes video data, causes the device to perform any of the second aspect and any of its various optional implementations. The method of processing video data described.

For the description of the related content and technical effects of the eighth aspect to the tenth aspect, reference may be made to the related description of the related content and technical effects of the second aspect and its various optional implementation manners, and details are not described herein again.

The term "and/or" in this article is just an association relationship describing related objects, indicating that there can be three relationships, for example, A and/or B, which can mean: A exists alone, A and B exist simultaneously, and B exists alone. three situations.

The terms “first” and “second” in the description and patent application scope of the embodiments of the present invention are used to distinguish different objects, rather than describing a specific order of objects. For example, the first threshold and the second threshold are used to distinguish different thresholds, rather than describing a specific order of the thresholds.

In the embodiments of the present invention, the words "exemplary" or "for example" are used as examples, illustrations or explanations. Any embodiments or design schemes described as “exemplary” or “for example” in the embodiments of the present invention should not be interpreted as being more preferred or more advantageous than other embodiments or design schemes. Rather, the use of words such as "exemplary" or "for example" is intended to present related concepts in a specific manner.

In the description of the embodiments of the present invention, unless otherwise stated, the meaning of "plurality" refers to two or more. For example, multiple coding units refer to two or more coding units; multiple processing units refer to two or more processing units.

First, some concepts involved in a method and apparatus for processing video data provided by embodiments of the present invention are explained.

Coding unit: includes coding blocks, which refers to dividing a video frame (that is, an image) to be coded into multiple image blocks, and one coding block includes one image block in the video frame, for example, as shown in the figure The video frame shown in 1 assumes that the size of the video frame is 128*128, and the video frame is divided into 4 image blocks of 64*64 size on average, then the video frame may include 4 encoding blocks, for example, where One coding block includes image block 1 in FIG. 1.

Sub-coding unit: includes sub-coding blocks, which refers to dividing one coding unit of the above video frame into multiple sub-blocks, and each sub-block may be called a sub-coding block. For example, as shown in FIG. 2, the video frame It is divided into 4 coding blocks on average. For one coding block, the coding block is divided into 4 sub-blocks, each sub-block is a sub-coding block (as shown in FIG. 2 sub-coding block 1 and sub-coding block 2 are coding blocks 1 sub-coding block).

In the video data encoding process, taking an encoding unit of the video data to be encoded as an example, the encoding device may first determine the prediction information of the encoding unit, and then encode the encoding unit according to the prediction information of the encoding unit. In the process of decoding video data, taking a coding unit of the video data to be decoded as an example, the decoding device may first determine the prediction information of the coding unit, and then determine the reconstruction information of the coding unit according to the prediction information of the coding unit. In summary, in the process of encoding and decoding video data, methods for determining prediction information of coding units may include intra prediction and inter prediction. The following describes intra prediction and inter prediction.

Residual information of coding unit: refers to the difference between the real information of the coding unit (that is, the original information) and the prediction information of the coding unit, that is, the difference between the real information of the coding unit and the prediction information of the coding unit.

Coding unit reconstruction information: refers to the reconstruction value of the coding unit primitive value determined based on the coding unit prediction information and the coding unit residual information. Specifically, the coding unit prediction information plus the coding unit residual information Then, the correlation filtering operation is performed on the sum of the two to eliminate the blockiness and obtain the reconstruction information of the coding unit.

For a video frame to be encoded, within the video frame to be encoded, the video frame is usually divided into multiple coding units, and the coding unit is used as the unit, from left to right, from top to bottom in order The encoded video frame is encoded, for example, in the video frame shown in FIG. 3, the video frame is divided into 9 coding units, denoted as CU1-CU9, and CU1-CU9 can be encoded in sequence according to the position order of CU1-CU9 To complete the encoding of the first video frame.

Intra-frame prediction: when encoding the current coding unit (which can be called the current coding unit), it can be compared with the current coding unit in the video frame where the current coding unit is located (which can be called the first video frame). Reconstruction information of neighboring (that is, adjacent to the spatial domain) coding unit (the coding unit adjacent to the current coding unit has completed coding) determines the prediction information of the current coding unit, that is, the predicted primitive value of the current coding unit, for example, As shown in FIG. 4, in the first video frame shown in FIG. 4, CU5 is an image block to be encoded, which can pass through at least one of CU1, CU2, CU3 above CU5, and CU4 on the left of CU5 The block predicts the pixel value of CU5.

Inter-frame prediction: when encoding the current coding unit (for example, the current coding unit), the current coding unit can be determined according to the video frame adjacent to the video frame where the current coding unit is located (which can be referred to as the first video frame). Prediction information (that is, the video frame adjacent to the first video frame is used as the reference frame of the first video frame, and then the image block (which may be referred to as a reference block) that is most similar to the current coding unit is determined in the second video frame, And use the reference block as prediction information of the current coding unit). Specifically, inter prediction includes prediction modes such as forward prediction, backward prediction, and bidirectional prediction. Forward prediction refers to determining the prediction information of the current coding unit in the previous frame of the first video frame, for example, as shown in FIG. 5 (A), the first video frame is denoted as F1, and the previous frame of the first video frame is denoted as F0. In F0, image block C0 is the prediction information of the current coding unit C1; backward prediction refers to The prediction information of the current coding unit is determined in the frame after the first video frame. For example, as shown in FIG. 5(b), the first video frame is denoted as F0, and the frame after the first video frame is denoted as F2, in In F2, image block C2 is the prediction information of the current coding unit; bidirectional prediction refers to determining the prediction information of a current coding unit in the previous frame of the first video frame, and also in the subsequent frame of the current coding unit Prediction information of a current coding unit, and then determine the prediction information of the current coding unit according to these two prediction information, as shown in FIG. 5(c), the first video frame is marked as F1, and the previous frame of the first video frame is marked Is F0, the next frame of the first video frame is denoted as F2, the image block C0 in F0 is a prediction information of the current coding unit, the image block C2 in F2 is also a prediction information of the current coding unit, and finally, The prediction information of the current coding unit is determined according to C0 and C2.

Motion vector of coding unit: In the case of video encoding and decoding using inter prediction, for a coding unit (such as the current coding unit), the video frame where the current coding unit is located is the first video frame, and the In the reference frame of a video frame (the previous frame of the first video frame and/or the next frame of the first video frame), if the image block at the position corresponding to the current coding unit (called the first image block), The image block that most closely matches the current coding unit (that is, most similar to the current coding unit) is the second image block, and the motion vector of the current coding unit refers to the one that moves from the first image block to the second image block Movement displacement. As shown in Fig. 6, F1 represents the first video frame, F2 represents the reference frame of the first video frame, assuming that CU1 is the current coding unit, the image block at the corresponding position of CU1 in F2 is CU2, and CU3 in F2 is the same as CU1 For the most matching image block, the motion vector of the center primitive point of the image block is used as the fast motion vector of the image. If the motion vector of CU2 is (0, 0), the lower left of CU2 is 1 longitudinal distance from CU2 , The lower left position with a lateral distance of 1 is CU3, the relative motion displacement of CU2 and CU3 is (-1, 1), and the motion vector of CU1 is (-1, 1).

Based on the problems existing in the encoding and decoding of video data in the background art, embodiments of the present invention provide a method and apparatus for processing video data. The encoding device can determine whether the information of the encoding unit satisfies the encoding of the sub-encoding unit according to the actual situation of the encoding unit Decoding conditions, and then use the corresponding encoding method to encode the video data. Similarly, the decoding device can also determine whether the information of the encoding unit meets the encoding and decoding conditions of the sub-encoding unit, and then use the corresponding decoding method to decode the video data, which can reduce the video data. Codec complexity.

The method and apparatus for processing video data provided by the embodiments of the present invention can be applied to the scenario of encoding or decoding video materials. The method can be applied to devices with encoding and/or decoding functions, in embodiments of the present invention , The device that encodes the video material is called an encoding device, and the device that decodes the video material is called a decoding device. After the encoding device obtains the video material, the encoding device encodes the video material and can compress the video material for storage The video material does not need to occupy a large storage space, and when the video material is sent to other devices, there is no need to occupy a large transmission bandwidth. In this way, encoding the video material is conducive to the storage and rapid transmission of the video material; decoding equipment After obtaining the encoded video data, the encoding device can decode the video data and restore the complete information of the video data, so as to ensure the smooth playback of the video data.

The method for processing video data provided by the embodiments of the present invention may be applied to an encoding device and a decoding device. The encoding device and the decoding device may be desktop computers, mobile computing devices, notebook (such as laptop) computers, tablet computers, and computers. Handsets such as set-top boxes, smart phones, televisions, cameras, display devices, digital media players, video game consoles, in-vehicle computers, or other similar devices.

The following describes in detail each component of the encoding device provided by the embodiment of the present invention with reference to FIG. 7. As shown in FIG. 7, the encoding device provided by the embodiment of the present invention includes: a video source 10, a video transcoder 11, an output interface 12, and other components. Those skilled in the art may understand that the structure of the encoding device shown in FIG. 7 does not constitute a limitation on the encoding device, and it may include more or less components such as those shown in FIG. 7 or may be combined as shown in FIG. 7 Some of the components shown may be arranged differently than the components shown in FIG. 7.

The video source 10 may include a video capture device (such as a video camera), a video archive containing previously captured video data, a video input interface to receive video data from a video content provider, and/or computer graphics for generating video data System, or a combination of the above video sources.

The video transcoder 11 can encode the video data obtained by the encoding device into a code that can be recognized by the machine according to the encoding standard (for example, H.264), so as to compress the video data, which is beneficial to the transmission and storage of the video data. The video transcoder 11 may be a central processing unit (CPU), a general-purpose processor, a digital signal processor (DSP), an application-specific integrated circuit (ASIC), or on-site. Field programmable gate array (FPGA) or other programmable logic devices, transistor logic devices, hardware components, or any combination thereof, which can implement or execute various examples described in the contents disclosed in the embodiments of the present invention Logical blocks, modules and circuits; the video transcoder 11 can also be a combination of computing functions, for example, including one or more microprocessor combinations, DSP and microprocessor combinations, etc.

The output interface 12 is an interface circuit for sending data to other devices. The output interface 12 may be a transceiver, a transceiver circuit, or other structure with a transceiver function, including a modulator/demodulator (data modem) and/or a transmitter. In the codec system, the output interface 12 can send the encoded video data to the decoding device.

Optionally, the encoding device shown in FIG. 7 may further include a wireless fidelity (WiFi) module, a Bluetooth module, and so on, and details are not described herein again.

The following describes in detail each component of the decoding device provided by the embodiment of the present invention with reference to FIG. 8. As shown in FIG. 8, the decoding device provided by the embodiment of the present invention includes an input interface 20, a video decoder 21, a display device 22, and other components. Those skilled in the art may understand that the structure of the encoding device shown in FIG. 8 does not constitute a limitation on the encoding device, and it may include more or less components such as those shown in FIG. 8 or may be combined as shown in FIG. 8 Some of the components shown may be arranged differently than the components shown in FIG. 8.

The input interface 20 is used to receive data sent by other devices (such as encoding devices). The input interface 20 may be a receiver and/or a modem. In the video codec system, the input interface 20 can receive the encoded video material sent by the encoding device.

The video decoder 21 can restore and decode the encoded video data it receives, that is, decompresses, so that the decoded video data can be played on the display device. The video decoder 21 may be a CPU, general-purpose processor, DSP, ASIC, FPGA, or other programmable logic device, transistor logic device, hardware component, or any combination thereof, which may implement or execute the content disclosed in the embodiments of the present invention The various exemplary logical blocks, modules and circuits described; the video decoder 21 may also be a combination of computing functions, for example, including one or more microprocessor combinations, DSP and microprocessor combinations, and so on.

The display device 22 is used to display decoded video data. The display device may include various display devices, such as a liquid crystal display (LCD), a plasma display, and an organic light-emitting diode (OLED) display Or other types of display devices. Optionally, the display device 22 may be integrated in the decoding device, or the display device 22 may be independent of the decoding device and provided outside the decoding device.

Combining the above application scenarios and the communication system, an embodiment of the present invention provides a method for processing video data. The method may include encoding and decoding video data. The following describes a video data encoding method and a video data decoding method.

Optionally, in the embodiment of the present invention, when encoding and decoding the current coding unit, different methods such as a motion vector prediction method (for example, SMVP technology), DMVD technology, or non-translational motion model may be used to encode and decode the current coding unit. Taking these three methods as examples, the coding and decoding process of the current coding unit is exemplarily described.

Method 1: Use SMVP technology to encode and decode

In the embodiments of the present invention, methods for encoding and decoding using SMVP technology are described separately. When encoding using SMVP technology, the method for processing video data provided by the embodiments of the present invention can be applied to an encoding device. When decoding using SMVP technology, the present invention The method for processing video materials provided in the embodiments can be applied to a decoding device.

First, when encoding using SMVP technology, as shown in FIG. 9, the method for processing video data provided by the embodiment of the present invention may include S101-S104:

S101. The encoding device determines whether the information of the current encoding unit meets the encoding and decoding conditions of the sub-encoding unit.

Wherein, the current coding unit includes a coding block, and the coding block includes an image block in the currently coded video frame, and the currently coded video frame is a frame of the video material to be coded.

In the embodiment of the present invention, after the encoding device obtains the video data, the encoding device encodes the video data. Encoding the video data refers to encoding each frame of the video data. Specifically, the video data to be encoded ( That is, one frame (such as the first video frame) in the video material acquired by the encoding device as an example. The encoding device divides the first video frame into multiple coding units, and then encodes each coding unit to complete the first video. Frame encoding.

It should be noted that, in the embodiment of the present invention, for the relevant description of the coding unit, refer to the relevant description of the coding unit in the introduction of some concepts involved in the embodiment of the present invention in the above embodiment, and the size of the coding unit can be based on the actual situation Determine, for example, for a 256*256 video frame, the video frame may be divided into 4 coding units of size 128*128, or the video frame may be divided into 16 64*64 coding units, or The video frame is divided into 64 coding units with a size of 32*32, which is not specifically limited in the embodiment of the present invention.

In the embodiment of the present invention, since the size of the video frame is usually relatively large, the encoding device directly processes all the data of the video frame, which may occupy more resources of the encoding device, which may cause the encoding device to be unable to process other services. When encoding, after each video frame is divided into multiple coding units, the encoding device can encode the entire video frame by encoding each encoding unit, so that the encoding device can successfully complete the encoding of the video material.

After the above coding device divides a video frame into multiple coding units, during the coding device's coding of one coding unit (such as the above-mentioned current coding unit), since the motion direction of each pixel point of the current coding unit may be different, If the current coding unit is directly encoded, the prediction information of the determined current coding unit may be inaccurate, resulting in an inaccurate encoding result of the current coding unit, so the encoding device may first determine whether the information of the current coding unit satisfies the sub-coding unit Encoding and decoding conditions, and then according to the determined result, determine whether to subdivide the current coding unit into at least two sub-coding units, and then select an appropriate coding method to encode at least two sub-coding units to complete the current coding unit coding.

In the embodiment of the present invention, the information of the current coding unit meeting the coding and decoding conditions of the sub-coding unit may include that the information of the current coding unit satisfies at least one of the following conditions A1 and A2:

A1. The size information of the current coding unit meets the coding and decoding size conditions of the sub-coding unit.

In the embodiment of the present invention, the size information of the current coding unit satisfies the coding and decoding size conditions of the sub-coding unit, including that the size information of the current coding unit satisfies any one of the following conditions B1-B3:

B1. The number of picture elements of the current coding unit is greater than or equal to the first threshold.

In the embodiment of the present invention, when the number of picture elements of the current coding unit is greater than or equal to the preset first threshold, it means that the size of the current coding unit is relatively large, and the coding device may consume more resources of the coding device when coding the coding unit.

B2. The ratio of the number of picture elements of the current coding unit to the number of picture elements of the first sub-coding unit is greater than or equal to the second threshold.

In the embodiment of the present invention, after the first sub-coding unit is divided into at least two sub-coding units, one of the at least two sub-coding units, the size of the sub-coding unit may be preset . The ratio of the number of picture elements of the current coding unit to the number of picture elements of the first sub-coding unit is greater than or equal to a preset second threshold value. Similarly, it means that the size of the current coding unit is relatively large.

B3. The width of the current coding unit is greater than or equal to the third threshold, or the height of the current coding unit is greater than or equal to the fourth threshold.

In the embodiment of the present invention, the width of the current coding unit is greater than the preset third threshold, indicating that the size of the current coding unit is larger, or the height of the current coding unit is greater than or equal to the fourth threshold, indicating that the size of the current coding unit is large.

It should be noted that, in the embodiment of the present invention, the first threshold, the second threshold, the third threshold, and the fourth threshold may be set according to actual conditions, and the embodiment of the present invention is not specifically limited. The third threshold may be equal to the fourth threshold.

A2. The prediction information of at least one coding unit adjacent to the current coding unit is obtained according to the motion information of the sub-coding units of the adjacent coding unit.

In the embodiment of the present invention, when the video recording device encodes the current coding unit, if the video recording device determines that the prediction information of the coding unit adjacent to the current coding unit among the already coded coding units is based on the sub-coding of the adjacent coding unit If the motion information of the unit is obtained, the video recording device determines that the prediction information of the current coding unit can also be obtained according to the motion information of the sub-coding unit of the current coding unit.

S102. If the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, the coding device obtains the motion information of at least two sub-coding units.

The at least two sub-coding units are sub-coding units obtained after the current coding unit is divided, and the sub-coding units include sub-coding blocks.

It can be understood that, since the motion information can represent a current coding unit or a sub-coding unit can be obtained by offsetting the already coded coding unit or sub-coding unit, as long as the motion information of the coding unit or sub-coding unit is determined , You can quickly determine the prediction information of the current coding unit based on the motion information.

In the embodiment of the present invention, if the information of the current coding unit satisfies at least one of the above A1 and A2, the encoding device may divide the current coding unit into at least two sub-coding units, and then obtain the respective Sports information.

It should be noted that in the embodiment of the present invention, the encoding device may determine the size of the sub-encoding unit according to the actual situation, for example, the current encoding unit size is 64*64, and the encoding device may divide the current encoding unit into 4 sizes of 32 *32 sub-coding units, the encoding device can also divide the current coding unit into 16 sub-coding units with a size of 16*16, and can also divide the current coding unit into 32 sub-coding units with a size of 8*8. The embodiments of the invention are not specifically limited.

In the embodiment of the present invention, the motion information of the one sub-coding unit includes at least one of the prediction direction indication information of the sub-coding unit, the motion vector of the sub-coding unit, and the reference block indication information of the sub-coding unit.

In the embodiment of the present invention, when encoding the current coding unit, the method for determining the prediction information of the current coding unit may include forward prediction, backward prediction, or bidirectional prediction. Then, the prediction direction indication information of the sub-coding unit is used to indicate The method for determining the prediction information of the current coding unit is forward prediction, backward prediction, bidirectional prediction, or other prediction directions; for the description of the motion vector of the sub-coding unit, please refer to the relevant description of the motion vector of the coding unit in the above embodiment, It is not repeated here; the reference block indication information of the sub-coding unit refers to the index of the video frame where the image block (which may be referred to as a reference block) that is most similar to the sub-coding unit can be based on the index of the video frame. It is known in which frame of the video material to be encoded that the reference block is an image block.

Exemplarily, in the embodiment of the present invention, it is assumed that in the motion information of the above sub-coding units, the prediction indication direction of one sub-coding unit (which may be called a first sub-coding unit) is forward prediction, and the motion of the first sub-coding unit The vector is (1, 0) and the reference block indication information of the first sub-coding unit is 10, then the encoding device determines the video frame where the first sub-coding unit is located (that is, the video frame where the current coding unit is located, that is, the first video Frame) and the video frame with index 10 (which can be called the second video frame), determine the sub-coding unit (which can be called the second sub-coding unit) corresponding to the position of the first sub-coding unit, and then In the second video frame, the sub-coding unit with a distance of (1, 0) from the second sub-coding unit (which may be referred to as a third sub-coding unit) is the sub-coding unit most similar to the first sub-coding unit Then, the primitive value of the third sub-coding unit is used as the primitive value of the first sub-coding unit, that is, the third sub-coding unit is used as the prediction information of the first sub-coding unit.

It should be noted that, in the embodiment of the present invention, a method for acquiring motion information of at least two sub-coding units will be described in detail in S103 below.

S103. The coding device determines the first candidate motion information list of the current coding unit according to the motion information of at least two sub-coding units.

The first candidate motion information list includes motion information and current coding units of at least two sub-coding units.

In the embodiment of the present invention, S103 may be specifically implemented through S103a-S103e:

S103a. The encoding device acquires motion information of multiple image blocks adjacent to the current coding unit airspace, and checks the availability and repetition of the motion information of the multiple image blocks, and sends the first candidate motion information according to the inspection result. Add sports information to the list.

In the embodiment of the present invention, the encoding device acquires motion information of multiple image blocks adjacent to the current coding unit spatial domain, obtains multiple motion information, and uses the multiple motion information as candidate motion information of the current coding unit. There may be unusable motion information in the candidate motion information of the coding unit, for example, there is no motion information in the uncoded image block; there may also be duplicate motion information in the current motion information of the coding unit, and the coding device determines 4 For example, the motion information of adjacent image blocks in the spatial domain. Among the four pieces of motion information acquired by the encoding device, two of the motion information are the same, and the two motion information are repeated. After the encoding device determines the unavailable sports information and the repeated sports information, the encoding device deletes the unavailable sports information and the repeated sports information in the candidate sports (a sports information is retained in the repeated sports information, and the remaining repeated sports information are both Delete), and then the encoding device adds the remaining sports information (sport information other than unavailable and repeated sports information in the candidate sports information) to the first candidate sports information list.

Optionally, in the embodiment of the present invention, the number of image blocks adjacent to the spatial domain of the current coding unit may include multiple, specifically, the number of image blocks adjacent to the spatial domain of the current coding unit may be determined according to actual conditions The embodiments of the present invention are not specifically limited.

It should be noted that in the embodiment of the present invention, the size of the image block adjacent to the spatial domain of the current coding unit may be the same as the size of the current coding unit, or may be different from the size of the current coding unit, that is, the spatial domain of the current coding unit The size of the adjacent image block may be smaller than the size of the current coding unit, may be equal to the size of the current coding unit, or may be larger than the size of the current coding unit, which is not specifically limited in this embodiment of the present invention.

S103b. The encoding device acquires the motion information of each of the at least two sub-coding units, and checks the availability and repetition of the motion information of the at least two sub-coding units, and adds the sub-coding unit to the first candidate motion information list according to the check result. Sports information.

In the embodiment of the present invention, for all sub-coding units in at least two sub-coding units, an advanced temporal motion vector prediction (ATMVP) method may be used to obtain motion information of each sub-coding unit. All are called ATMVP motion information of sub-coding units, and/or spatial-temporal motion vector prediction (STMVP) method is used to obtain the motion information of each sub-coding unit. STMVP sports information.

It should be noted that, in the following embodiments, the method of determining the candidate motion information list of the current coding unit is described by taking the motion information of the sub-coding units acquired by the coding device as ATMVP motion information and STMVP motion information as examples. In practical applications, ATMVP sports information and/or STMVP sports information may be selected and obtained according to the actual situation, which is not specifically limited in the embodiments of the present invention.

In the embodiment of the present invention, taking one of the at least two sub-coding units (for example, called the first sub-coding unit) as an example, the method for the encoding device to obtain the ATMVP motion information of the first sub-coding unit is: encoding The device obtains the motion information of the image block at the corresponding position in the reference frame of the first video frame where the first sub-encoding unit is located (referred to as the corresponding block of the first sub-encoding unit), and performs scaling to obtain the Sports information.

，

（1）Exemplarily, the picture order count (POC) of the video frame where the first sub-coding unit is located (ie, the first video frame) is denoted as D1, and the POC of the reference frame of the first video frame is denoted as D2, the first The POC of the video frame (for example, called the second video frame) where the corresponding block of the sub-coding unit is located is recorded as D3, and the POC of the reference frame of the second video frame (that is, the video frame where the corresponding block of the first sub-coding unit is located) As D4, the motion information of the corresponding block of the first sub-coding unit is recorded as MV, then the motion information MVs of the first sub-coding unit can be obtained by formula (1):

,

(1)

表示縮放因數，縮放因數可以表徵MVs相對於MV來說，縮放的程度。among them,

Represents a scaling factor, which can characterize the degree of scaling of MVs relative to MV.

In the embodiment of the present invention, taking one of the at least two sub-coding units (for example, the above-mentioned first sub-coding unit) as an example, the method for the encoding device to obtain the STMVP motion information of the first sub-coding unit is: the encoding device Obtain the motion information of the image blocks adjacent to the spatial domain of the first sub-coding unit (for example, above and to the left of the first sub-coding unit), and obtain the temporal domain of the first sub-coding unit (for example, the first sub-coding The motion information of image blocks adjacent to the time domain in the lower left corner of the unit, and then averaging the motion information of image blocks adjacent to the spatial domain and the motion information of image blocks adjacent to the time domain to obtain the first sub-code Unit sports information.

Exemplarily, as shown in FIG. 10, image block 1 represents a first sub-coding unit, image block 2 and image block 3 are image blocks adjacent to the spatial domain of the first sub-coding unit, and image block 4 is The image block adjacent to the first sub-coding unit in the time domain, the encoding device determines the motion information of the image block 2 and the image block 3 adjacent to the spatial domain of the image block 1, and the image block adjacent to the time domain 3 motion information, and then the encoding device averages the motion information of image block 2, image block 3, and image block 4.

In the embodiment of the present invention, after the encoding device obtains the motion information (that is, ATMVP motion information and STMVP motion information) of all the sub coding units of the current coding unit, the coding device checks the availability and repetition of the motion information of all the sub coding units, and Delete the unavailable sports information and the repeated sports information, and then the encoding device adds the remaining sports information (sport information other than the unavailable and repeated sports information) to the first candidate sports information list.

S103c. If the length of the motion information in the first candidate motion information list is less than the first length threshold, the encoding device continues to obtain motion information of image blocks adjacent to the spatial domain of the current coding unit, and checks its availability and repetition, and Add sports information to the first candidate sports information list according to the check result, otherwise directly execute S103d.

In the embodiment of the present invention, the first candidate motion information list of the coding device includes candidate motion information of the current coding unit, and also includes motion information of all sub-coding units of the current coding unit, and the motion information in the first candidate motion information list The length is the amount of motion information in the first candidate motion information list, and the first length threshold is the number of the first candidate motion information and the number of sub-coding unit motion information without considering the deletion of unusable and repeated motion information For example, if the above coding device obtains motion information of the image blocks adjacent to the four spatial domains of the current coding unit, the number of candidate motion information of the current coding unit is 4, and the motion information of the sub coding units obtained by the coding device includes ATMVP and STMVP , The number of motion information of the sub-coding unit is 2, so, the first length threshold of the first candidate motion information list is 6, if in S103a, the encoding device uses one of the four candidate motion information of the current coding unit Delete, then the length of the first candidate sports information list is 3, and then, in S103b, the encoding device does not delete the sports information, and adds the 2 sports information of the sub-coding unit (ie, ATMVP sports information and STMVP sports information) to the first candidate In the sports information list, the length of the first candidate sports information list is 5.

In the embodiment of the present invention, the length of the motion information in the first candidate motion information list is less than the first length threshold, indicating that the amount of motion information in the first candidate motion information list is relatively small, and then the encoding device may continue to move to the first candidate Add new sports information to the information list.

S103d. The encoding device obtains the motion information of the image blocks adjacent to the time domain of the current coding unit, scales it, and adds it to the first candidate motion information list.

Optionally, in the embodiment of the present invention, the image block adjacent to the time domain of the current coding unit in S103d (that is, the image block in the reference frame of the first video frame) may be an image at a specific specified position Block, if the motion information of the image block does not exist, you can select an image block in the reference block corresponding to the position of the current coding unit in the reference frame of the first video frame and move the motion of the image block The information is added to the first candidate sports information list.

It should be noted that, in the embodiment of the present invention, the size of the image block adjacent to the current coding unit in the time domain may be the same as the size of the current coding unit, or may be different from the size of the current coding unit. limited.

S103e. If the length of the motion information in the first candidate motion information list is less than the second length threshold, the encoding device fills the first candidate motion information list.

In the embodiment of the present invention, the second length threshold refers to the length of the first candidate motion information list after S103d without considering the deletion of the candidate motion information of the current coding unit and the motion information of at least two sub-coding units. Exemplarily, in the above S103a, the number of candidate motion information of the current coding unit is 4, and in S103b, the number of motion information of each of the at least two sub-coding units is 2, then the second length threshold is 7.

In the embodiment of the present invention, the encoding device determines that the length of the motion information in the first candidate motion information list is less than the second length threshold, then the coding device fills the first candidate motion information list with new motion information so that the first candidate motion information The length of the list is equal to the second length threshold.

Optionally, in the embodiment of the present invention, the encoding device may fill the first candidate motion information list with the motion information whose motion vector is (0,0), and the encoding device may also according to the context of the first video frame where the current coding unit is located. The video frame determines the motion information to be filled. The method of filling the sports information is a commonly used existing technology, which will not be repeated here.

At this point, the encoding device obtains the first candidate motion information list of the current coding unit, so that the encoding device can determine the prediction information of the current coding unit according to the motion information in the first candidate motion information list.

S104. The encoding device obtains prediction information of the current encoding unit according to the first candidate motion information list.

Optionally, with reference to FIG. 9 and FIG. 11, in the embodiment of the present invention, S104 may be implemented through S104a-S104b:

S104a. The encoding device determines the first target candidate motion information in the first candidate motion information list.

In the embodiment of the present invention, after the encoding device obtains the first candidate motion information list, the encoding device may determine the optimal motion information (referred to as the first target candidate motion information) from the first candidate motion information list, The first target candidate motion information is the candidate motion information with the smallest residual (that is, the aforementioned first residual information) of the prediction information of the current coding unit determined from all candidate motion information in the first candidate motion information list.

（2）Optionally, in the embodiment of the present invention, the encoding device may use a rate-distortion optimization technique to determine the first target candidate motion information from the first candidate motion information list. Specifically, the encoding device may calculate the rate-distortion cost according to all candidate motion information in the first candidate motion list using the following formula (2), and then select the motion information with the lowest rate-distortion cost as the first target candidate motion information:

(2)

表示拉格朗日乘子（

可以為預設的常量），R表示視頻資料的碼率。Among them, J represents the rate distortion cost, RAD represents the sum of the absolute error between the prediction information of the current coding unit and the original information,

Means Lagrange multiplier (

Can be a preset constant), R represents the bit rate of video data.

In the embodiment of the present invention, the encoding device estimates the prediction information of the current coding unit according to each candidate motion information in the first candidate motion information list. Specifically, the encoding device determines the prediction information of the current coding unit based on the candidate motion information of the current coding unit in the first candidate motion information list, and the encoding device uses the motion information of the sub-coding unit in the first candidate motion information, for example According to the motion information of all the sub-coding units of the current coding unit, the prediction information of each sub-coding unit is determined to obtain the prediction information of the current coding unit, and then the encoding device calculates multiple prediction information rate distortion costs according to formula (2), The candidate motion information with the lowest rate-distortion cost is selected as the first target candidate motion information.

S104b. The encoding device determines prediction information of the current coding unit according to the first target candidate motion information.

In the embodiment of the present invention, the coding device determining the prediction information of the current coding unit according to the first target candidate motion information may specifically be: the coding device uses the primitive value of the image block corresponding to the first target candidate motion information as the prediction of the current coding unit News.

Optionally, in the embodiment of the present invention, referring to FIG. 11 and as shown in FIG. 12, after the above S104, the method for processing video data provided by the embodiment of the present invention may further include S105:

S105. The encoding device encodes the indication information used to indicate the first target candidate motion information into the code stream of the current encoding unit.

In the embodiment of the present invention, after the encoding device finishes encoding the current encoding unit, the encoding device may encode the indication information of the first target candidate motion information determined by the encoding device into the code stream. Thus, after decoding and encoding, the current encoding unit encodes During the code stream, the decoding device may obtain the indication information of the first target candidate motion information of the current coding unit from the code stream.

Optionally, in the embodiment of the present invention, the indication information of the first target candidate sports information may be an index of the first target candidate sports information in the first candidate sports information list. Of course, the indication of the first target candidate sports information The information is also set to other instruction information that meets the usage requirements, and the embodiment of the present invention is not specifically limited.

In the embodiment of the present invention, referring to FIG. 9, after the above S104, the method for processing video data provided by the embodiment of the present invention may further include S106:

S106. The encoding device obtains the original information of the current encoding unit.

S107. The encoding device encodes the current coding unit according to the prediction information of the current coding unit and the original information of the current coding unit.

In the embodiment of the present invention, in the process of encoding video data, the original information of the current coding unit is known information (that is, the real primitive value in the current coding unit), and the encoding device obtains the original information of the current coding unit , The original information of the current coding unit and the prediction information of the current coding unit are subtracted to obtain the residual information of the current coding unit (hereinafter referred to as the first residual information), and then the encoding device encodes the first residual information, The second residual information is obtained, that is, the code stream after the current coding unit is coded.

Specifically, the encoding device encodes the first residual information by transforming the first residual information (such as discrete cosine transformation (DCT), etc.), quantizing, and entropy encoding to obtain the second residual information, The current coding unit after coding is obtained.

Optionally, in the embodiment of the present invention, the encoding device sends the encoded information (ie, code stream) of the current encoding unit to the decoding device. In this way, after the decoding device receives the second residual information sent by the encoding device, the decoding device The second residual information can be decoded to recover the complete information of the current coding unit corresponding to the second residual information.

Optionally, in the embodiment of the present invention, after the encoding device determines the prediction information and the first residual information of the current coding unit, the encoding device may determine the reconstruction information of the current coding unit.

In the embodiment of the present invention, the encoding device adds the prediction information of the current encoding unit to the first residual information determined by the encoding device to obtain reconstruction information of the current encoding unit. The reconstruction information of the current encoding unit is used by the encoding device to The unit to be encoded is encoded (for example, the unit to be encoded is a first encoding unit), and the first encoding unit is one encoding unit in the video frame to be encoded. For example, if the first coding unit is the next coding unit of the current coding unit, during the process of coding the first coding unit by the coding device, when the coding device determines the prediction information of the first coding unit, it may use the reconstruction information of the current coding unit as Reference information of the first coding unit.

In the embodiment of the present invention, in the process of encoding video data, through the above S101, if the encoding device determines that the information of the current encoding unit does not meet the encoding and decoding conditions of the sub-encoding unit, it means that the size of the current encoding unit is small, and the encoding device does not need to The current coding unit is divided into at least two sub-coding units, and then the prediction information of the current coding unit is determined according to the motion information of the sub-coding unit. The encoding device can determine the prediction information of the current coding unit according to the motion information of the current coding unit. It can reduce the complexity of encoding video data by the encoding device.

Specifically, in the embodiment of the present invention, referring to FIG. 9, as shown in FIG. 13, if the information of the current encoding unit does not satisfy the encoding and decoding conditions of the sub-encoding unit, the method for processing video data provided by the embodiment of the present invention may further include S108 -S110:

S108. If the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the encoding device determines a second list of motion information of the current coding unit. The second list of candidate motion information includes candidate motion information of the current coding unit.

The second motion information list does not include the motion information of at least two sub-coding units.

In the embodiment of the present invention, if the decoding device determines that the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, the decoding device can learn the length of the candidate motion information list of the current decoding unit. For example, generally, the information of one coding unit satisfies the sub-coding When the unit coding and decoding conditions, the length of the candidate motion information list can be 7, and when the information of one coding unit does not meet the coding and decoding conditions of the sub coding unit, the length of the candidate motion information list can be 5.

Specifically, the encoding device determines that the second candidate motion information list includes acquiring at least one candidate motion information of the current coding unit, and then adding the at least one candidate motion information to the first candidate motion information list. The above S108 may be implemented through S108a-S108d:

S108a. The encoding device acquires motion information of multiple image blocks adjacent to the current coding unit airspace, and checks the availability and repetition of the motion information of the multiple image blocks, and sends Add sports information to the candidate sports information list.

For a specific description of S108a, reference may be made to the related description of S103a in the foregoing embodiment, and details are not described herein again.

S108b. If the length of the motion information in the second candidate motion information list is less than the third length threshold, the encoding device continues to acquire motion information of image blocks adjacent to the spatial domain of the current coding unit, and checks its availability and repetition, and Add sports information to the second candidate sports information list according to the check result, otherwise directly execute S108c.

In the embodiment of the present invention, the third length threshold refers to the number of candidate motion information of the current coding unit without considering the deletion of the motion information in the candidate motion information acquired by the encoding device in S108a.

For other descriptions of S108b, reference may be made to the related description of S103c in the foregoing embodiment, and details are not described herein again.

S108c. The encoding device acquires the motion information of the image blocks adjacent to the time domain of the current coding unit, performs scaling, and adds it to the second candidate motion information list.

For a specific description of S108c, reference may be made to the related description of S103d in the foregoing embodiment, and details are not described herein again.

S108d. If the length of the motion information in the second candidate motion information list is less than the fourth length threshold, the encoding device fills the second candidate motion information list.

In the embodiment of the present invention, the fourth length threshold refers to the length of the second candidate motion information list after S108c without considering the deletion of the candidate motion information of the current coding unit determined in S108a and S108b. If the encoding device determines that the length of the motion information in the second candidate motion information list is less than the fourth length threshold, the encoding device fills the second candidate motion information list with new motion information so that the length of the second candidate motion information list is equal to the Four length thresholds.

The second candidate motion information can be obtained through the above S108a-S108d, so that the encoding device can determine the prediction information of the current coding unit according to the motion information in the second candidate motion information list.

It should be noted that in the embodiment of the present invention, the second candidate sports information list in S108d is different from the candidate sports information list in S103e, and the first candidate sports information list described in S103e includes the sports in the second candidate sports information list in S108d Information, the candidate motion information list in S103e includes motion information of at least two sub-coding units and motion information of the current coding unit.

S109. The encoding device determines second target candidate motion information in the second candidate motion information list.

S110. The encoding device determines the prediction information of the current coding unit according to the second target candidate motion information.

For other descriptions of S109-S110, reference may be made to the related descriptions of 104a-S104b in S104 in the foregoing embodiment, and details are not described herein again.

Optionally, in the embodiment of the present invention, with reference to FIG. 13, after S110, the method for processing video data provided by the embodiment of the present invention may further include S111:

S111. The encoding device encodes the indication information for indicating the second target candidate motion information into the code stream of the current encoding unit.

It should be noted that, in the embodiment of the present invention, when the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the prediction information of the current coding unit can be determined through S108-S110, and the above-mentioned S106-S107 can be executed To encode the current coding unit.

In the embodiment of the present invention, the encoding device encodes (ie compresses) the video material and sends it to the decoding device. When the decoding device plays the video material, it decodes the encoded video material first to obtain the decoded video material (ie, the original Video material), then the decoding device can play the video material.

When decoding using SMVP technology, as shown in FIG. 14, the method for processing video data provided by the embodiment of the present invention may include S201-S204:

S201. The decoding device determines whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit.

It should be noted that in the embodiment of the present invention, in the process of decoding video materials, the above-mentioned sub-coding unit codec conditions may be the same as the sub-coding unit codec conditions in the process of encoding video materials, that is, the sub-coding unit in S101 The coding and decoding conditions of the coding unit are the same. Therefore, for the specific description of S201, reference may be made to the related description of S101 in the foregoing embodiment, and details are not described herein again.

S202. If the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, the decoding device obtains the motion information of each of the at least two sub-coding units.

S203. The decoding device determines the first candidate motion information list of the current coding unit according to the motion information of at least two sub-coding units.

In the embodiments of the present invention, for specific descriptions of S201-S203, refer to the related descriptions of S101-S102 in the foregoing embodiments, and details are not described herein again.

S204. The decoding device obtains prediction information of the current coding unit according to the first candidate motion information list.

In the embodiment of the present invention, referring to FIG. 14 and as shown in FIG. 15, S204 may be specifically implemented through S204a-S204c:

S204a. The decoding device acquires instruction information for indicating the first target candidate motion information in the first candidate motion information list.

It can be understood that, in the above-mentioned encoding process, after the encoding device determines the first target candidate motion information from the first candidate motion information list, the encoding device may incorporate indication information for indicating the first target candidate motion information into the current The code stream of the coding unit (that is, the code stream encoded into the current coding unit after encoding), and then sent to the decoding device. In this way, after the decoding device receives the code stream of the current coding unit, the decoding device can extract the code stream from the current coding unit. The indication information of the first target candidate motion information is acquired to determine the first target candidate motion information under the indication of the first target candidate motion information.

For a specific description of the indication information of the first target candidate motion information, reference may be made to the related description of S105 in the foregoing embodiment, and details are not described herein again.

S204b. The decoding device determines the first target candidate motion information according to the first candidate motion information list and the indication information of the first target candidate motion information.

S204c. The decoding device determines prediction information of the current coding unit according to the first target candidate motion information.

In the embodiment of the present invention, the decoding device can determine the first target candidate motion information in the first candidate motion information list under the instruction information of the first target candidate motion information, thereby determining the current according to the first target candidate motion information The motion information of the coding unit.

For a specific description of S204c, reference may be made to the related description of S104b in the foregoing embodiment, and details are not described herein again.

Optionally, in the embodiment of the present invention, after the above S204, the method for processing video data provided by the embodiment of the present invention may further include S205-S206:

S205. The decoding device decodes the code stream after it receives the current encoding unit encoding to obtain the first residual information.

In the embodiment of the present invention, in the encoding process of the video data, the encoding device encodes the current encoding unit, that is, encodes the first residual information in S107 above, to obtain second residual information (that is, the code after the current encoding unit is encoded Stream), the encoding device sends the code stream after the current encoding to the decoding device, and the decoding device decodes the code stream after the current encoding unit is encoded, that is, decoding the second residual information (including entropy of the second residual information) Decoding, inverse quantization, and inverse transform) to obtain the first residual information.

S206. The decoding device determines reconstruction information of the current coding unit according to the prediction information of the current coding unit and the first residual information.

In the embodiment of the present invention, the decoding device adds the prediction information of the current coding unit to the first residual information, and then performs a relevant filtering operation on the sum of the two to obtain the reconstruction information of the current coding unit, that is, the decoding device The complete primitive information of the current coding unit can be obtained, and then the decoding device can obtain the complete primitive information of the video data to be decoded by determining the reconstruction information of all coding units, so that the decoding device can play the video data smoothly.

In the embodiment of the present invention, referring to FIG. 15, as shown in FIG. 16, through the above S201, if the decoding device determines that the information of the current coding unit does not meet the coding and decoding conditions of the sub-coding unit, the method for processing video data provided by the embodiment of the present invention It can also include S207-S210:

S207. The decoding device determines a second candidate motion information list of the current coding unit. The second candidate motion information list includes candidate motion information of the current coding unit.

The second candidate motion information list does not include motion information of at least two sub-coding units.

In the embodiment of the present invention, for the method for determining the second candidate motion information list, reference may be made to the related description of the method for determining the second candidate motion information list in S108 above, and details are not described herein again.

S208. If the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the decoding device obtains indication information for indicating the second target candidate motion information in the second candidate motion information list.

It can be understood that in the above-mentioned process of encoding video data, after the encoding device determines the second target candidate motion information from the second candidate motion information list, the encoding device may program the instruction information for indicating the second target candidate motion information The code stream of the current coding unit (that is, the code stream of the current coding unit after being encoded), and then sent to the decoding device. In this way, after the decoding device receives the code stream of the current coding unit, the decoding device can select the code stream of the current coding unit. The instruction information of the second target candidate motion information is acquired in order to determine the second target candidate motion information under the instruction of the second target candidate motion information.

S209. The decoding device determines the second target candidate motion information according to the second candidate motion information list and the indication information of the second target candidate motion information.

S210. The decoding device determines prediction information of the current coding unit according to the second target candidate motion information.

In the embodiment of the present invention, since the decoding device determines the second target candidate motion information, and determines the prediction information of the current coding unit according to the second target candidate motion information, and in the above encoding process, the encoding device determines the second target candidate motion information, and based on The method for determining the prediction information of the current coding unit by the second target candidate motion information is similar. Therefore, for the specific description of S209-S210, reference may be made to the related description of S109-S110 in the foregoing embodiment, and details are not described here.

It should be noted that, in the embodiment of the present invention, in the case where the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the prediction information of the current coding unit can be determined through S207-210, and the above S205-S206 can be executed To decode the current coding unit.

In the embodiment of the present invention, when the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, the first candidate motion information list including the motion information of at least two sub-coding units and the motion information of the current coding unit may be determined , And determine the prediction information of the current coding unit according to the first candidate motion information list, and the coding and decoding of the current coding unit has been completed; in the case that the information of the current coding unit does not meet the coding and decoding conditions of the sub coding unit, it can be determined that the current coding is included The first candidate motion information list of the unit's motion information, and the prediction information of the current coding unit is determined according to the first candidate motion information list, and the coding and decoding of the current coding unit has been completed.

The method for processing video data provided by the embodiment of the present invention can be applied to the process of encoding and decoding video data. First, it can be determined whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, and if the information of the current coding unit satisfies the sub-coding unit Encoding and decoding conditions, then obtain the motion information of at least two sub-coding units, and then determine the motion information including the motion information of at least two sub-coding units and the current coding unit according to the motion information of the at least two sub-coding units The first candidate motion information list, and then the prediction information of the current coding unit is determined according to the first candidate motion information list. Compared with the prior art, in the embodiment of the present invention, since the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, it can be determined whether to divide the current coding unit into sub-coding units for coding according to the actual situation of the current coding unit or For decoding, when the size of the current coding unit is small, there is no need to divide the current coding unit into sub-coding units, and then encode or decode. Therefore, the complexity of encoding and decoding of video materials can be reduced.

Method 2: Use DMVD technology to encode and decode

In the embodiments of the present invention, methods for encoding and decoding using DMVD technology are described separately. When encoding using DMVD technology, the method for processing video data provided by embodiments of the present invention can be applied to encoding devices. When decoding using DMVD technology, the present invention The method for processing video materials provided in the embodiments can be applied to a decoding device.

First, when encoding with DMVD technology, as shown in Figure 17, if the information of the current encoding unit meets the encoding and decoding conditions of the sub-encoding unit, the encoding device can also use DMVD technology to obtain the motion information of at least two sub-encoding units to determine The prediction information of the current coding unit. Specifically, using DMVD technology, the method for determining the prediction information of the current coding unit may include S301-S303:

S301. The encoding device determines whether the information of the current encoding unit satisfies the encoding and decoding conditions of the sub-encoding unit.

For a specific description of S301, reference may be made to the above related description of S101 or S201, which will not be repeated here.

S302. If the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, the encoding device obtains the motion information of each of the at least two sub-coding units.

In the embodiment of the present invention, as shown in FIG. 18 in conjunction with FIG. 17, S302 may be specifically implemented through S3021-S3022:

S3021: The encoding device obtains the motion information of the current encoding unit.

S3021 can be specifically implemented through S3021a-S3021c:

S3021a. The encoding device constructs an initial search list of the current encoding unit.

S3021b. The encoding device determines the initial search point according to the initial search list of the current encoding unit.

In the embodiment of the present invention, the encoding device may use the motion information of some image blocks adjacent to the current coding unit as the initial search list of the current coding unit, and then the encoding device determines a motion information from the initial search list as the current coding unit's The initial search point.

Specifically, the method for the encoding device to determine a motion information from the initial search list as the initial search point of the current coding unit may include: the encoding device uses a motion estimation matching method based on all the motion information and search templates in the initial search list to select The motion information corresponding to the template with the smallest matching error, and using the motion information corresponding to the template with the smallest matching error as the initial search point. Specifically, each motion information in the search starting list can correspond to a template, and according to the estimated current coding unit information of all the templates, the error between the estimated current coding unit information and the original information of the current coding unit is minimized. The motion information corresponding to the template serves as the initial search point.

S3021c. The encoding device uses the initial search point as a starting point and uses a relevant search algorithm to determine the motion information of the current encoding unit.

In the embodiment of the present invention, the encoding device may use a related search algorithm (for example, a diamond search algorithm) to determine the motion information of the current encoding unit.

Exemplarily, as shown in FIG. 19, the initial search point is O, and the initial search point O is the center point of the diamond, with a preset step length in the horizontal direction and the vertical direction (including the horizontal step length and vertical Direction step) extension, you can determine four points, namely D1, D2, D3 and D4, and then connect these four points in sequence to get the diamond D1D2D3D4, and determine the midpoint of the four sides of the diamond D1D2D3D4 , That is, the midpoint D5 of the edge D1D2, the midpoint D6 of the edge D2D3, the midpoint D7 of the edge D3D4 and the midpoint D8 of the edge D4D1, so that D1, D2, D3, D4, D5, D6, D7, D8 and O these 9 points, these 9 points represent 9 pieces of motion information, so that the encoding device determines one piece of motion information from these 9 pieces of motion information as the motion information of the current coding unit.

It should be noted that, in the embodiment of the present invention, the encoding device determines a motion from the motion information searched in the above diamond search algorithm (for example, the above 9 motion information determined in the example shown in FIG. 19 above) The method for information is the same as the method for the encoding device to determine a piece of motion information from the initial search list. For details, reference may be made to the related description of S3021b in the foregoing embodiment, and details are not described here.

S3022. The encoding device performs motion search using the motion information of the current coding unit as the initial motion information of at least two sub-coding units, respectively, so as to obtain the motion information of at least two sub-coding units.

In the embodiment of the present invention, the encoding device may determine the respective motion information of all sub-coding units of the current coding unit according to the motion information of the current coding unit. Taking a sub-coding unit of the current coding unit (for example, the first sub-coding unit) as an example, the method for the encoding device to obtain motion information of the first sub-coding unit may include:

S3022a. The encoding device uses the motion information of the current coding unit as an initial search point, and uses a relevant search algorithm (such as a positive cross search algorithm) to determine the motion information of the first sub-coding unit.

Exemplarily, as shown in FIG. 20, the initial search point is O1, with the initial search point O1 as the center point, and a preset step length (including the horizontal step length and the vertical direction) along the horizontal direction and the vertical direction Step length) extension, you can determine four points, namely E1, E2, E3 and E4, so you can get 5 points E1, E2, E3, E4 and O, these 5 points represent 5 sports information, Therefore, the encoding device determines a motion vector from the five motion vectors as the motion vector of the first sub-coding unit.

It can be understood that the encoding device may determine the respective motion information of all sub-coding units of the current coding unit through S3022a, that is, determine the respective motion information of the at least two sub-coding units.

It should be noted that in the embodiment of the present invention, the encoding device uses a certain search algorithm to determine the motion information of a coding unit, or according to a certain search algorithm, determines the motion information of a sub-coding unit, the decoding device also uses The corresponding search algorithm determines the motion information of the coding unit, or the motion information of the sub-coding unit.

S303. The coding device determines the prediction information of the current coding unit according to the motion information of at least two sub-coding units.

In the embodiment of the present invention, after the encoding device obtains the motion information of at least two sub-coding units, the encoding device may determine the prediction information of each sub-coding unit according to the motion information of each sub-coding unit of the current coding unit, so that Determine the prediction information of the current coding unit.

It should be noted that, in the embodiment of the present invention, after the encoding device determines the prediction information of the current encoding unit, the encoding device may execute the above-mentioned S106-S107 to encode the current encoding unit.

In the embodiment of the present invention, referring to FIG. 17, as shown in FIG. 21, through the above S301, if the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the method for processing video data provided by the embodiment of the present invention may further include S304-S305:

S304. If the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the encoding device obtains the motion information of the current coding unit.

For a specific description of S304, reference may be made to the related description of S3021 in the foregoing embodiment, and details are not described herein again.

S305. The coding device determines the prediction information of the current coding unit according to the motion information of the current coding unit.

Similarly, in the case that the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, after the encoding device determines the prediction information of the current coding unit, it may perform the above S103-S107 to encode the current coding unit.

When using DMVD technology for decoding, the method for processing video data provided by the embodiments of the present invention may include S401-S403:

S401. The decoding device determines whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit.

For a specific description of S401, reference may be made to the related description of S101, S201, or S301 in the foregoing embodiment, and details are not described herein again.

S402. If the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, the decoding device obtains the motion information of each of the at least two sub-coding units.

S403. The decoding device determines the prediction information of the current coding unit according to the motion information of at least two sub-coding units.

In the embodiment of the present invention, in the process of encoding and decoding video data by using DMVD technology, the method for the decoding device to determine the prediction information of the current coding unit is similar to the method for the coding device to determine the prediction information of the current coding unit. Therefore, for S401-S403 For the detailed description, please refer to the relevant descriptions of S301-S303, which will not be repeated here.

It should be noted that, in the embodiment of the present invention, the prediction information of the current coding unit can be determined through S401-403, and the above S205-S206 can be executed to decode the current coding unit.

In the embodiment of the present invention, through the above S401, if the decoding device determines that the information of the current coding unit does not meet the coding and decoding conditions of the sub-coding unit, the method for processing video data provided in the embodiment of the present invention may further include S404-S405:

S404. The decoding device obtains the motion information of the current coding unit.

S405. The decoding device determines the prediction information of the current coding unit according to the motion information of the current coding unit.

For the specific descriptions of S404-S405, please refer to the related descriptions of S304-305 in the above embodiments, which will not be repeated here.

Similarly, in the case that the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, after the decoding device determines the prediction information of the current coding unit, it may perform the above S205-S206 to decode the current coding unit.

Method 3: Use non-translational motion model codec

In the embodiment of the present invention, if the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, the encoding device may also use the non-translational motion model method to obtain the motion information of each of the at least two sub-coding units to determine the current coding unit Sports information. Commonly used non-translational motion models include a 6-parameter affine transformation type and a 4-parameter affine transformation model. The embodiment of the present invention uses a 4-parameter affine transformation model as an example to describe a method of determining prediction information of a current coding unit.

In the embodiment of the present invention, when non-translational motion model coding is adopted, the method for processing video data provided in the embodiment of the present invention may include S501-S503:

S501. The encoding device determines whether the information of the current encoding unit satisfies the encoding and decoding conditions of the sub-encoding unit.

For a specific description of S501, reference may be made to the related description of S101, S201, S301, or S401 in the foregoing embodiment, and details are not described herein again.

S502. If the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, the coding device obtains the motion information of each of the at least two sub-coding units.

In the embodiment of the present invention, as shown in FIG. 22, the above S502 may be specifically implemented through S502a-S502b:

S502a. The encoding device acquires motion information of at least two picture element positions of the current encoding unit.

In the embodiment of the present invention, the encoding device may determine the motion information of each sub-coding unit of the current coding unit according to the motion information of the coding unit where the image block adjacent to the current coding unit (adjacent to the spatial domain) is located. Specifically, the coding unit first determines the motion information of at least two picture element positions of the current coding unit according to the motion information of the coding unit where the image block adjacent to the current coding unit is located. The following determines the motion information of the two picture element positions in the upper left corner and the upper right corner of the current coding unit as an example to describe a method for the coding device to determine the motion information of at least two picture element positions of the current coding unit.

，該圖元點的運動向量為

，M1的右上角的圖元的座標為

，該圖元點的運動向量為

，M1的左下角的圖元的座標為

，該圖元點的運動向量為

；當前編碼單元的編碼單元左上角的圖元的座標為

，當前編碼單元的編碼單元右上角的圖元的座標為

，可以根據下面的公式（3）確定當前編碼單元的左上角的圖元的運動向量

和根據公式（4）當前編碼單元的右上角的圖元的運動向量

：

（3）Exemplarily, as shown in FIG. 23, the image block m1 in FIG. 23 is the adjacent image block of the current coding unit, M is the coded coding unit where the image block m1 is located, and the picture element in the upper left corner of the M1 The coordinates are

, The motion vector of the primitive point is

, The coordinates of the primitive in the upper right corner of M1 are

, The motion vector of the primitive point is

, The coordinates of the primitive in the lower left corner of M1 are

, The motion vector of the primitive point is

; The coordinates of the picture element in the upper left corner of the coding unit of the current coding unit are:

, The coordinates of the primitive in the upper right corner of the coding unit of the current coding unit are

, The motion vector of the primitive in the upper left corner of the current coding unit can be determined according to the following formula (3)

And the motion vector of the primitive in the upper right corner of the current coding unit according to formula (4)

:

(3)

（4）Where h is the height of M1 and w is the width of M1.

(4)

為當前編碼單元的寬。among them,

Is the width of the current coding unit.

S502b. The encoding device determines the motion information of at least two sub-coding units according to the motion information of at least two picture element positions of the current coding unit.

的運動向量和當前編碼單元的右上角的圖元點

的運動向量之後，可以根據公式（5）確定至少兩個子編碼單元各自的運動向量：

（5）In the embodiment of the present invention, still taking the motion information of the two picture element positions of the upper left corner and the upper right corner of the current coding unit as an example, the picture of the upper left corner of the current coding unit is determined according to the above formula (3) and formula (4) Meta point

The motion vector and the primitive point in the upper right corner of the current coding unit

After the motion vector of, the motion vector of each of the at least two sub-coding units can be determined according to formula (5):

(5)

Among them, (x, y) is the coordinate of a sub-coding unit.

Optionally, in the embodiment of the present invention, the coordinates of the central primitive point of the sub-coding unit may be used as the coordinates of the sub-coding unit.

It can be understood that by substituting the coordinates of each of the at least two sub-coding units into formula (5), the motion information of the at least two sub-coding units can be determined.

S503. The coding device determines the prediction information of the current coding unit according to the motion information of at least two sub-coding units.

For a specific description of S503, reference may be made to the related description of S303 in the foregoing embodiment, and details are not described herein again.

Optionally, in the embodiment of the present invention, referring to FIG. 22 and as shown in FIG. 24, after the above S503, the method for processing video data provided by the embodiment of the present invention may further include S504-S505:

S504. The encoding device determines the prediction mode of the current coding unit according to the prediction information of the current coding unit.

In the embodiment of the present invention, when the encoding device encodes the video data, the information of the current encoding unit satisfies the encoding and decoding conditions of the sub-encoding unit. After the encoding unit divides the current encoding unit into at least two sub-encoding units, the encoding device may first separately adopt The above SMVP technology, DMVD technology and non-translational motion model (can be called prediction mode) respectively predict the prediction information of the current coding unit, and then determine which of the three coding methods has the lowest rate distortion cost according to the rate distortion optimization technology, Then, an encoding method with the lowest rate-distortion cost is used to encode the video data, and the prediction mode with the lowest rate-distortion cost is determined as the prediction mode of the current coding unit.

S505. The encoding device encodes the prediction mode indication information into the code stream of the current coding unit. The value of the prediction mode indication information is used to indicate whether the prediction mode of the current coding unit is an affine transformation mode.

In the embodiment of the present invention, the encoding device encodes the prediction mode indication information of the current coding unit into the code stream of the current coding unit. Thus, after the decoding device receives the code stream of the current coding unit, the decoding device can learn the current according to the prediction mode indication information. Whether the prediction mode of the coding unit is an affine transformation mode.

It can be understood that, in the embodiment of the present invention, after the encoding device determines the prediction information of the current encoding unit, the encoding device may execute the above-mentioned S106-S107 to encode the current encoding unit.

It should be noted that, in the embodiment of the present invention, since the non-translational motion model is only used to obtain the motion information of the sub-coding unit, if the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the coding device cannot use The method of the non-translational motion model determines the motion information of the current coding unit. The encoding device may use other methods of determining the motion information of the coding unit to determine the motion information of the current coding unit.

Optionally, with reference to FIG. 22 and as shown in FIG. 25, in a case where the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the method for processing video data provided by the embodiment of the present invention may further include S506:

S506. The encoding device determines the prediction information of the current coding unit according to the set of candidate prediction modes, which does not include the affine transformation mode.

In the embodiment of the present invention, the set of candidate prediction modes may include a prediction mode coded using SMVP technology, a prediction mode coded using DMVD technology, and other prediction modes used to predict the prediction information of the current coding unit. No specific restrictions. In the case where the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the encoding device may use one of the methods in the set of candidate prediction modes to determine the prediction information of the current coding unit, and may execute the above S106-S107 to Current encoding unit encoding.

When decoding using a non-translational motion model, the method for processing video data provided by the embodiment of the present invention may include S601-S603:

S601. The decoding device determines whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit.

For the specific description of S601, reference may be made to the related description of S101, S201, S301, S401, or S501 in the foregoing embodiment, and details are not described herein again.

S602: If the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, decode and obtain the motion information of at least two sub-coding units.

In the embodiment of the present invention, as shown in FIG. 26, the above S602 may be specifically implemented through S602a-S602c:

S602a. The decoding device obtains prediction mode indication information. The value of the prediction mode indication information is used to indicate whether the prediction mode of the current coding unit is an affine transformation mode.

In the embodiment of the present invention, in the above embodiment, since the encoding device can encode the prediction mode indication information into the code stream of the current encoding unit, the decoding device can obtain the current encoding unit from the code stream after encoding the current encoding unit it receives Prediction information of the prediction mode, and determine whether to use the affine transformation mode of the non-translational motion model to determine the prediction information of the current coding unit according to the prediction mode instruction information.

S602b. If the value of the prediction mode indication information indicates that the current prediction mode is an affine transformation mode, the decoding device obtains motion information of at least two picture element positions of the current coding unit.

S602c. The decoding device determines the motion information of at least two sub-coding units according to the motion information of at least two picture element positions.

For specific descriptions of S602b-S602c, please refer to the related descriptions of S502a-S502b in the above embodiment, which will not be repeated here.

S603. The decoding device determines the prediction information of the current coding unit according to the motion information of the at least two sub-coding units.

For a specific description of S603, reference may be made to the related description of S403 in the foregoing embodiment, and details are not described herein again.

It should be noted that, in the embodiment of the present invention, when the decoding device determines that the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the decoding device may adopt other methods than the translational motion model (corresponding to the coding process of the coding device Corresponding decoding method), obtain the motion information of the current coding unit, and determine the prediction information of the current coding unit.

The method for processing video data provided by the embodiment of the present invention can be applied to the process of encoding and decoding video data. First, it is determined whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, and if the information of the current coding unit satisfies the sub-coding unit Under the condition of coding and decoding, the motion information of at least two sub-coding units is acquired, and then the prediction information of the current coding unit is determined according to the motion information of the at least two sub-coding units, and the encoding or decoding of the current coding unit is completed. Compared with the prior art, in the embodiment of the present invention, since it can be determined whether the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, and according to the actual situation of the current coding unit, it is determined whether to divide the current coding unit into sub-coding units for coding Or decoding. When the size of the current coding unit is small, there is no need to divide the current coding unit into sub-coding units, and then encode or decode. Therefore, the complexity of encoding and decoding of video materials can be reduced.

The above mainly introduces the solutions provided by the embodiments of the present invention from the perspective of each network element. It can be understood that, in order to realize the above-mentioned functions, each network element, such as a device for processing video data, includes a hardware structure and/or a software module corresponding to each function. Those skilled in the art should easily realize that, in combination with the exemplary units and algorithm steps described in the embodiments disclosed herein, the embodiments of the present invention can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed by hardware or computer software driven hardware depends on the specific application and design constraints of the technical solution. Professional technicians can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

The embodiments of the present invention may divide the functional modules of the device for processing video data according to the above method example, for example, each functional module may be divided corresponding to each function, or two or more functions may be integrated in one process In the module. The above integrated modules can be implemented in the form of hardware or software function modules. It should be noted that the division of the modules in the embodiment of the present invention is schematic, and is only a division of logical functions. In actual implementation, there may be another division manner.

In the case where each functional module is divided corresponding to each function, FIG. 27 shows a possible structural schematic diagram of the apparatus for processing video data involved in the above embodiment. As shown in FIG. 27, the apparatus may include: Module 30 and acquisition module 31. The determination module 30 can be used to support the device for processing video data to execute S101, S103, S104 (including S104a-S104b), S108, S109, S110, S201, S203, S204 (including S204b-S204c) in the above method embodiments, S206, S207, S209, 210, S301, S303, S305, S401, S403, S405, S501, S503, S504, S506, S601, and S603; the acquisition module 31 can be used to support devices that process video data to perform the above method embodiments S102, S106, S202, S204a, S208, S302 (including S3021-S3022), S304, S402, S404, S502 (including S502a-S502b) and S602 (including S602a-S602c). Optionally, as shown in FIG. 19, the apparatus for processing video data may further include an encoding module 32 and a decoding module. The encoding module 32 may be used to support a device for processing video data to execute S105, S107, S111, and S505 in the foregoing method embodiments. The decoding module can be used to support devices that process video data to execute S205, S107, and S111 in the above method embodiments. All relevant content of the steps involved in the above method embodiments can be referred to the function description of the corresponding function module. I will not repeat them here.

In the case of using an integrated unit, FIG. 28 shows a possible structural schematic diagram of the apparatus for processing video materials involved in the foregoing embodiment. As shown in FIG. 28, the device may include a processing module 40 and a communication module 41. The processing module 40 can be used to control and manage the operation of the device that processes video data. The processing module 40 can be used to support the device that processes video data to perform each step performed by each encoding device or decoding device in the foregoing method embodiment. And/or other processes for the techniques described herein. The communication module 41 can be used to support communication between the device for processing video data and other network entities. Optionally, as shown in FIG. 28, the apparatus for processing video data may further include a storage module 42 for storing code and data of the encoding device.

The processing module 40 may be a processor or a controller (for example, the video transcoder 11 shown in FIG. 7 and the video decoder 21 shown in FIG. 8 above), for example, a CPU or a general-purpose processor. , DSP, ASIC, FPGA or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. It can implement or execute various exemplary logical blocks, modules, and circuits described in conjunction with the disclosure of the embodiments of the present invention. The above processor may also be a combination that realizes a calculation function, for example, including one or more microprocessor combinations, a combination of DSP and microprocessor, and so on. The communication module 51 may be a transceiver, a transceiver circuit, or a communication interface (for example, the output interface 12 shown in FIG. 7 and the input interface 20 shown in FIG. 8). The storage module 42 may be a memory.

When the processing module 40 is a processor, the communication module 41 is a transceiver, and the storage module 42 is a memory, the processor, the transceiver, and the memory can be connected by a bus. The bus bar may be a peripheral component interconnect (PCI) bus or an extended industry standard architecture (EISA) bus. The bus can be divided into address bus, data bus, control bus, etc.

In the above embodiments, it can be implemented in whole or in part by software, hardware, firmware, or any combination thereof. When implemented using software programs, it can be implemented in whole or in part in the form of computer program products. The computer program product includes one or more computer instructions. When the computer instructions are loaded and executed on the computer, all or part of the processes or functions according to the embodiments of the present invention are generated. The computer can be a general-purpose computer, a dedicated computer, a computer network, or other programmable device. The computer instruction can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium, for example, the computer instruction can be passed from a website, computer, server or data center Wired (such as coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (such as infrared, wireless, microwave, etc.) to another website, computer, server or data center. The computer-readable storage medium may be any available medium that can be accessed by a computer or a data storage device including one or more available media integrated servers, data centers, and the like. The usable medium may be a magnetic medium (for example, a floppy disk, a magnetic disk, a magnetic tape), an optical medium (for example, a digital video disc (DVD)), or a semiconductor medium (for example, solid state drives (SSD) ))Wait.

Through the description of the above embodiments, those skilled in the art can clearly understand that, for convenience and conciseness of description, only the above-mentioned division of each functional module is used as an example for illustration. In actual applications, the above-mentioned functions can be used as needed The allocation is performed by different functional modules, that is, the internal structure of the device is divided into different functional modules to complete all or part of the functions described above. For the specific working processes of the system, device and unit described above, reference may be made to the corresponding processes in the foregoing method embodiments, which will not be repeated here.

In the several embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other ways. For example, the device embodiments described above are only schematic. For example, the division of the modules or units is only a division of logical functions. In actual implementation, there may be other divisions, for example, multiple units or elements may be The combination can either be integrated into another system, or some features can be ignored, or not implemented. In addition, the displayed or discussed mutual coupling or direct coupling or communication connection may be an indirect coupling or communication connection through some interfaces, devices or units, and may be in electrical, mechanical or other forms.

The unit described as a separate component may or may not be physically separated, and the component displayed as a unit may or may not be a physical unit, that is, it may be located in one place, or may be distributed on multiple network units . Some or all of the units may be selected according to actual needs to achieve the purpose of the solution of this embodiment.

In addition, each functional unit in each embodiment of the present application may be integrated into one processing unit, or each unit may exist alone physically, or two or more units may be integrated into one unit. The above integrated unit can be implemented in the form of hardware or software function unit. The above are only the preferred embodiments of the present invention, and all changes and modifications made in accordance with the scope of the patent application of the present invention shall fall within the scope of the present invention.

CU1～CU9‧‧‧Coding unit C0～C3‧‧‧Image block F0~F2‧‧‧Video frame 10‧‧‧Video source 11‧‧‧Video transcoder 12‧‧‧Output interface 20‧‧‧Input interface 21‧‧‧Video decoder 22‧‧‧Display device S101-S110, S201～S210, S301～S305, S501～S506, S601～S603 30‧‧‧ Confirm module 31‧‧‧Get Module 32‧‧‧Coding module 40‧‧‧Processing module 41‧‧‧Communication module 42‧‧‧storage module

1 is a schematic diagram 1 of dividing a video frame into coding units according to an embodiment of the present invention; FIG. 2 is a schematic diagram of dividing a coding unit into sub-coding units according to an embodiment of the present invention; FIG. 3 is provided by an embodiment of the present invention FIG. 4 is a schematic diagram of dividing a video frame into coding units; FIG. 4 is a schematic diagram of an intra prediction method provided by an embodiment of the present invention; FIG. 5(a) is a schematic diagram 1 of an inter prediction method provided by an embodiment of the present invention FIG. 5(b) is a schematic diagram 2 of an inter prediction method according to an embodiment of the present invention; FIG. 5(c) is a schematic diagram 3 of an inter prediction method according to an embodiment of the present invention; FIG. 6 is an embodiment of the present invention A schematic diagram of a motion vector of an encoding unit provided; FIG. 7 is a schematic hardware diagram of an encoding device according to an embodiment of the present invention; FIG. 8 is a schematic hardware diagram of a decoding device according to an embodiment of the present invention; FIG. 9 is an embodiment of the present invention A schematic diagram 1 of a method for processing video data provided by an embodiment; FIG. 10 is a schematic diagram 1 of a method for acquiring motion information of a sub-coding unit provided by an embodiment of the present invention; FIG. 11 is a method of processing video data provided by an embodiment of the present invention Schematic diagram two; Figure 12 is a schematic diagram three of a method for processing video data provided by an embodiment of the present invention; Figure 13 is a schematic diagram four of a method for processing video data provided by an embodiment of the present invention; Figure 14 is a processing method provided by an embodiment of the present invention Schematic diagram 5 of the method of video data; FIG. 15 is a diagram 6 of the method for processing video data provided by the embodiment of the present invention; FIG. 16 is a diagram 7 of the method of processing video data provided by the embodiment of the present invention; FIG. 17 is an embodiment of the present invention Schematic diagram 8 of a method for processing video data provided; FIG. 18 is a diagram 9 of a method for processing video data provided by an embodiment of the present invention; FIG. 19 is a schematic diagram 1 of a method for determining motion information of a coding unit provided by an embodiment of the present invention; 20 is a schematic diagram 1 of a method for determining motion information of a sub-coding unit provided by an embodiment of the present invention; FIG. 21 is a schematic diagram 10 of a method for processing video data provided by an embodiment of the present invention; FIG. 22 is a method provided by an embodiment of the present invention Schematic diagram 11 of a method for processing video data; FIG. 23 is a schematic diagram 2 of a method for determining motion information of sub-coding units according to an embodiment of the present invention; FIG. 24 is a schematic diagram 12 of a method for processing video data according to an embodiment of the present invention; 25 is a schematic diagram 13 of a method for processing video data provided by an embodiment of the present invention; FIG. 26 is a schematic diagram 14 of a method for processing video data provided by an embodiment of the present invention; FIG. 27 is a method of processing video data provided by an embodiment of the present invention Schematic structure 1 of the device; FIG. 28 is a second structure diagram of the device for processing video data provided by an embodiment of the present invention.

S101-S104‧‧‧Step

Claims (30)

A method for processing video data, characterized in that whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, and the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit includes the information of the current coding unit At least one of the following conditions is met: the size information of the current coding unit satisfies the codec size condition of the sub-coding unit; the prediction information of at least one coding unit adjacent to the current coding unit is based on the adjacent coding The motion information of the sub-coding unit of the unit is obtained; if it is determined that the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, the respective motion information of at least two sub-coding units is obtained, and the at least two sub-coding units are the A sub-coding unit obtained by dividing the current coding unit; based on the motion information of the at least two sub-coding units, determining a first candidate motion information list of the current coding unit, the first candidate motion information list including at least The motion information of the two sub-coding units and the candidate motion information of the current coding unit; according to the first candidate motion information list, the prediction information of the current coding unit is obtained. The method according to claim 1, wherein the size information of the current coding unit satisfies the codec size condition of the sub-coding unit includes that the size information of the current coding unit satisfies any one of the following conditions: The number of picture elements of the current coding unit is greater than or equal to the first threshold; the ratio of the number of picture elements of the current coding unit to the number of picture elements of the first sub-coding unit is greater than or equal to the second threshold, the first sub-coding unit is One of the at least two sub-coding units; the width of the current coding unit is greater than or equal to a third threshold, or the height of the current coding unit is greater than or equal to a fourth threshold. The method according to claim 1 or 2, wherein the method is applied to a decoding device, and the obtaining prediction information of the current coding unit according to the first candidate motion information list includes: obtaining Indication information indicating the first target candidate sports information in the first candidate sports information list; determining the first target candidate sports information based on the first candidate sports information list and the indication information of the first target candidate sports information ; Determine the prediction information of the current coding unit according to the first target candidate motion information. The method according to claim 1 or 2, wherein the method is applied to a decoding device, and if the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit, the method further includes: determining A second candidate motion information list of the current coding unit, the second candidate motion information list including candidate motion information of the current coding unit; acquiring a second target candidate motion for indicating the second candidate motion information list Information indicative information; based on the second candidate sports information list and the indication information of the second target candidate sports information, determine the second target candidate sports information; based on the second target candidate information, determine the current encoding Forecast information for the unit. The method according to claim 1, wherein the method is applied to an encoding device, and the obtaining prediction information of the current coding unit according to the first candidate motion information list includes: in the first The first target candidate motion information is determined in the candidate motion information list; the prediction information of the current coding unit is determined according to the first target candidate motion information. The method according to claim 1, wherein the method is applied to an encoding device, and if the information of the current encoding unit does not satisfy the encoding and decoding conditions of the sub-encoding unit, the method further includes: determining the current A second candidate motion information list of the coding unit, the second candidate motion information list including the candidate motion information of the current coding unit; determining a second target candidate motion information in the second candidate motion information list; according to the The second target candidate motion information determines the prediction information of the current coding unit. The method according to claim 5 or 6, characterized in that the method is applied to an encoding device, and the method further comprises: encoding indication information for indicating target candidate motion information into the code stream of the current encoding unit. A method for processing video data, characterized in that whether the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, and the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit includes the information of the current coding unit At least one of the following conditions is met: the size information of the current coding unit satisfies the codec size condition of the sub-coding unit; the prediction information of at least one coding unit adjacent to the current coding unit is based on the adjacent coding The motion information of the sub-coding unit of the unit is obtained; if the information of the current coding unit satisfies the coding and decoding conditions of the sub-coding unit, the motion information of at least two sub-coding units is acquired, and the at least two sub-coding units are A sub-coding unit obtained by dividing the current coding unit; obtaining prediction information of the current coding unit according to respective motion information of the at least two sub-coding units. The method according to claim 8, wherein the acquiring motion information of each of the at least two sub-coding units includes: acquiring motion information of the current coding unit; using the motion information of the current coding unit as Each initial motion information of the at least two sub-coding units performs a motion search, so as to obtain respective motion information of the at least two sub-coding units. The method according to claim 8 or 9, wherein if the information of the current coding unit does not satisfy the encoding and decoding conditions of the sub-coding unit, the method further comprises: acquiring motion information of the current coding unit; The prediction information of the current coding unit is determined according to the motion information of the current coding unit. The method according to claim 8, wherein the method is applied to a decoding device, and the acquiring motion information of at least two sub-encoding units includes: acquiring prediction mode indication information, the prediction mode indication information The value is used to indicate whether the prediction mode is an affine transformation mode; if the value of the prediction mode indication information indicates that the current prediction mode is an affine transformation mode, acquiring motion information of at least two primitive positions of the current coding unit ; Determining the motion information of the at least two sub-coding units according to the motion information of the at least two primitive positions. The method according to claim 8, wherein the method is applied to an encoding device, and the acquiring motion information of at least two sub-encoding units includes: acquiring at least two image element positions of the current encoding unit Based on the motion information of the at least two primitive positions, determine the respective motion information of the at least two sub-coding units. The method according to claim 8 or 12, wherein the method is applied to an encoding device, the method further comprising: determining a prediction mode of the current coding unit according to prediction information of the current coding unit; The prediction mode indication information is incorporated into the code stream of the current coding unit, and the value of the prediction mode indication information is used to indicate whether the prediction mode is an affine transformation mode. The method according to claim 8 or 12, wherein the method is applied to an encoding device, and if the information of the current encoding unit does not satisfy the encoding and decoding conditions of the sub-encoding unit, the method further includes: The prediction mode set determines the prediction information of the current coding unit, and the candidate prediction mode set does not include the affine transformation mode. An apparatus for processing video data is characterized by comprising a determination module and an acquisition module; the determination module is used to determine whether the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, and the information of the current coding unit Satisfying the encoding and decoding conditions of the sub-encoding unit includes that the information of the current encoding unit satisfies at least one of the following conditions: the size information of the current encoding unit satisfies the encoding and decoding size condition of the sub-encoding unit; at least one Prediction information of coding units adjacent to the coding unit is obtained according to the motion information of sub-coding units of the adjacent coding unit; the acquiring module is configured to determine in the determining module that the information of the current coding unit satisfies the In the case of the encoding and decoding conditions of the sub-encoding unit, acquiring motion information of at least two sub-encoding units, the at least two sub-encoding units being sub-encoding units obtained by dividing the current encoding unit; the determining module , Also used to determine the first candidate motion information list of the current coding unit according to the motion information of the at least two sub-coding units obtained by the obtaining module, the first candidate motion information list includes at least two The motion information of each sub-coding unit and the candidate motion information of the current coding unit, and according to the first candidate motion information list, the prediction information of the current coding unit is obtained. The apparatus according to claim 15, wherein the size information of the current coding unit satisfies the codec size condition of the sub-coding unit includes that the size information of the current coding unit satisfies any one of the following conditions: The number of picture elements of the current coding unit is greater than or equal to the first threshold; the ratio of the number of picture elements of the current coding unit to the number of picture elements of the first sub-coding unit is greater than or equal to the second threshold, the first sub-coding unit is One of the at least two sub-coding units; the width of the current coding unit is greater than or equal to a third threshold, or the height of the current coding unit is greater than or equal to a fourth threshold. The device according to claim 15 or 16, wherein the device is a decoding device; and the acquiring module is further configured to acquire a first target candidate motion for indicating the first candidate motion information list Information indicating information; the determining module is specifically configured to determine the first target candidate sports information based on the first candidate motion information list and the indication information of the first target candidate motion information, and according to the first The target candidate motion information determines the prediction information of the current coding unit. The device according to claim 15 or 16, characterized in that the device is a decoding device; and the determining module is further used when the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit In the case, a second candidate motion information list of the current coding unit is determined, the second candidate motion information list includes candidate motion information of the current coding unit; the acquisition module is also used to acquire The indication information of the second target candidate sports information in the second candidate sports information list; the determining module is further used to obtain the second target according to the second candidate sports information list and the acquiring module The indication information of the candidate motion information determines the second target candidate motion information, and determines the prediction information of the current coding unit based on the second target candidate motion information. The device according to claim 15, wherein the device is an encoding device; the determining module is specifically configured to determine the first target in the first candidate sports information list acquired by the acquiring module Candidate motion information, and based on the first target candidate motion information, determine prediction information of the current coding unit. The device according to claim 15, characterized in that the device is an encoding device; and the determining module is further used when the information of the current encoding unit does not satisfy the encoding and decoding conditions of the sub-encoding unit , Determine the second candidate motion information list of the current coding unit, and determine the second target candidate motion information in the second candidate motion information list, and determine the current encoding based on the second target candidate motion information Prediction information of the unit, the second candidate motion information list includes candidate motion information of the current coding unit. The device according to claim 19 or 20, characterized in that the device is an encoding device, and the encoding device further includes an encoding module; the encoding module is used for indicating an indication of target candidate motion information The information is compiled into the code stream of the current coding unit. An apparatus for processing video data is characterized by comprising a determination module and an acquisition module; the determination module is used to determine whether the information of the current coding unit meets the coding and decoding conditions of the sub-coding unit, and the information of the current coding unit Satisfying the encoding and decoding conditions of the sub-encoding unit includes that the information of the current encoding unit satisfies at least one of the following conditions: the size information of the current encoding unit satisfies the encoding and decoding size condition of the sub-encoding unit; at least one Prediction information of coding units adjacent to the coding unit is obtained according to the motion information of the sub-coding units of the adjacent coding unit; the acquisition module is used to determine that the information of the current coding unit is satisfied by the determination module In the case of the encoding and decoding conditions of the sub-encoding unit, acquiring motion information of at least two sub-encoding units, the at least two sub-encoding units being sub-encoding units obtained after the current encoding unit is divided; the determining The module is also used to obtain the prediction information of the current coding unit according to the motion information of the at least two sub-coding units obtained by the obtaining module. The device according to claim 22, wherein the acquiring module is specifically configured to acquire the motion information of the current coding unit, and respectively use the motion information of the current coding unit as the at least two sub-components The initial motion information of each coding unit performs a motion search to obtain the motion information of each of the at least two sub-coding units. The device according to claim 22 or 23, wherein the acquisition module is further configured to acquire information about the current coding unit when the information of the current coding unit does not satisfy the coding and decoding conditions of the sub-coding unit Motion information; the determination module is also used to determine the prediction information of the current coding unit based on the motion information of the current coding unit acquired by the acquisition module. The device according to claim 22, wherein the device is a decoding device; the acquisition module is specifically configured to acquire prediction mode indication information, and the value of the prediction mode indication information indicates that the current prediction mode is In the case of the affine transformation mode, acquiring the motion information of at least two primitive positions of the current coding unit, and determining the respective motion of the at least two sub-coding units according to the motion information of the at least two primitive positions For motion information, the value of the prediction mode indication information is used to indicate whether the prediction mode is an affine transformation mode. The device according to claim 22, wherein the device is an encoding device; the acquiring module is further used to acquire motion information of at least two primitive positions of the current encoding unit, and according to the The motion information of at least two picture element positions determines the motion information of each of the at least two sub-coding units. The device according to claim 22 or 26, characterized in that the device is an encoding device, and the encoding device further includes an encoding module; the determining module is further used for predicting information based on the current encoding unit To determine the prediction mode of the current coding unit; the coding module is used to program the prediction mode indication information determined by the determination module into the code stream of the current coding unit, and the prediction mode indicates information The value is used to indicate whether the prediction mode is an affine transformation mode. The device according to claim 22 or 26, characterized in that the device is an encoding device; and the determining module is further used when the information of the current encoding unit does not satisfy the encoding and decoding conditions of the sub-encoding unit In this case, the prediction information of the current coding unit is determined according to a set of candidate prediction modes that does not include the affine transformation mode. An apparatus for processing video data is characterized by comprising a processor and a memory coupled to the processor; the memory is used to store computer instructions, and when the apparatus is running, the processor executes the The computer instructions stored in the memory to cause the device to execute the method for processing video data according to any one of the items 1 to 7 or to execute the device according to any one of the items 8 to 14 The method of processing video data. A computer-readable storage medium, characterized by including computer instructions, when the computer instructions run on a device for processing video data, causing the device to perform processing of video data according to any one of request items 1 to 7 The method of causing the device to execute the method of processing video data as described in any one of the items 8 to 14.

Images