CN110933410B - HEVC video inter-frame prediction method and device - Google Patents

HEVC video inter-frame prediction method and device Download PDF

Info

Publication number
CN110933410B
CN110933410B CN201911074393.XA CN201911074393A CN110933410B CN 110933410 B CN110933410 B CN 110933410B CN 201911074393 A CN201911074393 A CN 201911074393A CN 110933410 B CN110933410 B CN 110933410B
Authority
CN
China
Prior art keywords
sub
coding unit
kinematic
coding units
inter
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201911074393.XA
Other languages
Chinese (zh)
Other versions
CN110933410A (en
Inventor
欧阳国胜
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing Jiaxun Feihong Electrical Co Ltd
Original Assignee
Beijing Jiaxun Feihong Electrical Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Beijing Jiaxun Feihong Electrical Co Ltd filed Critical Beijing Jiaxun Feihong Electrical Co Ltd
Priority to CN201911074393.XA priority Critical patent/CN110933410B/en
Publication of CN110933410A publication Critical patent/CN110933410A/en
Application granted granted Critical
Publication of CN110933410B publication Critical patent/CN110933410B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/96—Tree coding, e.g. quad-tree coding
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/109—Selection of coding mode or of prediction mode among a plurality of temporal predictive coding modes
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/182—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being a pixel

Abstract

The embodiment of the invention discloses a HEVC video inter-frame prediction method and a HEVC video inter-frame prediction device, wherein the method comprises the following steps: when the first kinematic severity is not 0, comparing the first kinematic severity of the first sub-coding unit with the sum of the second kinematic severity of four second sub-coding units corresponding to the first sub-coding unit; if the first motion intensity of the first sub-coding unit is greater than the sum of the second motion intensities of the four second sub-coding units corresponding to the first sub-coding unit, dividing the first sub-coding unit into four second sub-coding units with next division depth, and determining an inter-frame prediction mode of the second sub-coding units according to the difference between the second motion intensities of the four second sub-coding units with the next division depth; otherwise, stopping continuously dividing the corresponding first sub-coding units, and determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the division depth where the first sub-coding units are located.

Description

HEVC video inter-frame prediction method and device
Technical Field
The invention relates to the field of information source coding communication, in particular to an HEVC video inter-frame prediction method and device.
Background
The video encoder performs encoding compression on the original data to obtain as little reconstruction distortion as possible, or to obtain as low a bitrate as possible. Many new techniques such as more complex inter/intra prediction algorithms, variable block size motion compensation, multi-mode block partitioning, variable size block transforms, motion vectors supporting 1/4 pixel accuracy, rate distortion optimization techniques, etc. are employed for this purpose. The improvement of the compression performance is at the cost of increasing a large amount of calculation, and great inconvenience is brought to video real-time coding communication.
In order to reduce the complexity of the HEVC coding process, in the prior art, some methods utilize texture information and stable region detection information of an image to determine whether a current CU (coding unit) needs to be further divided by setting a threshold value; some utilization Rate Distortion (RD) cost determination threshold values terminate the continuous segmentation of the current CU in advance, and effective processing is not carried out on the selection of the inter-frame prediction mode; some current blocks are segmented by utilizing the distribution characteristic of gray level difference, but the distortion of gray level binary filtering is large, and the effect is not ideal; some methods calculate the eigenvalue of Pyramid Motion Divergence (PMD) by using an optical flow method to judge the segmentation condition of the CU, so that the complexity is effectively reduced, but the correlation among motion vectors is not fully considered, so that the performance of coding RD is poor; some JND models and ADD decisions are utilized to quickly select coding depth and inter-frame prediction modes, but for sequences with complex textures, the algorithm has a limited effect of reducing complexity; some depth value predictions are performed through weighting of adjacent CUs in a time-space domain, so that the depth traversal times of a Largest Coding Unit (LCU) are reduced, but the difference between sequences is not considered by a fixed weight algorithm, so that errors exist in the predicted depth range.
Disclosure of Invention
In view of the above technical problems, embodiments of the present invention provide an HEVC video inter-frame prediction method and apparatus.
A first aspect of an embodiment of the present invention provides an HEVC video inter-frame prediction method, where an HEVC video includes multiple frames of continuously acquired images, and the method includes:
determining the texture complexity of the maximum coding unit according to the width and the height of each maximum coding unit in the current image and the pixel value of each pixel point in the maximum coding unit;
if the texture complexity is smaller than or equal to a preset threshold value, determining that the segmentation depth of the maximum coding unit is 0 or 1; otherwise, determining the maximum coding unit partition depth to be 2 or 3;
calculating a first kinematic severity of a first sub-coding unit corresponding to the split depth of 0 or 2 and a second kinematic severity of each of four second sub-coding units of a next split depth corresponding to the first sub-coding unit;
when the first kinematic severity is 0, stopping continuously dividing the corresponding first sub-coding unit, and determining the inter-frame prediction mode of the first sub-coding unit as an SKIP/merge mode;
when the first kinematic intensity is not 0, comparing the first kinematic intensity of the first sub-coding unit with the sum of the second kinematic intensities of four second sub-coding units corresponding to the first sub-coding unit;
if the first kinematic severity of the first sub-coding unit is greater than the sum of the second kinematic severity of the four second sub-coding units corresponding to the first sub-coding unit, dividing the first sub-coding unit into four second sub-coding units of a next division depth, and determining an inter-frame prediction mode of the second sub-coding units according to the difference between the second kinematic severity of the four second sub-coding units of the next division depth; otherwise, stopping continuously dividing the corresponding first sub-coding units, and determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the division depth where the first sub-coding units are located.
Optionally, the calculating of the first and second sports intensity includes:
and determining the kinematic severity of each sub-coding unit under the corresponding division depth according to the width and height of each sub-coding unit under the corresponding division depth, the size of the corresponding division depth, the pixel value of each pixel point in each sub-coding unit under the corresponding division depth and the pixel value of each pixel point in the region of the previous frame image of the current image, which is at the same position as each sub-coding unit under the corresponding division depth.
Optionally, the sports severity FDdThe calculation formula of (2) is as follows:
Figure BDA0002261942800000031
wherein d is the corresponding segmentation depth;
Wdand HdRespectively the width and the height of the sub-coding unit under the corresponding segmentation depth d;
(x, y) is the relative position coordinates of the pixel points in each sub-coding unit;
Figure BDA0002261942800000032
the absolute coordinate position of each sub coding unit under the corresponding division depth d is the pixel value of (i, j);
Figure BDA0002261942800000033
and (3) the pixel value of the pixel point with the absolute coordinate position (i, j) at the corresponding segmentation depth in the previous frame image of the current image is obtained.
Optionally, the determining the inter prediction mode of the second sub-coding unit according to the difference between the second kinematic severity of the four second sub-coding units of the next partition depth includes:
if any difference value of the two-by-two difference values of the second kinematic intensity of the four second sub-coding units is larger than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the second sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic intensity of the four second sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic intensity of any two adjacent second sub-coding units and the sum of the second kinematic intensity of other two second sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the second sub-coding unit as SMP;
if any difference value of the pairwise difference values of the second motion severity of the four second sub-coding units is smaller than or equal to a product of a mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining an inter-frame prediction mode of the second sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1;
and/or the presence of a gas in the gas,
determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the split depth where the first sub-coding unit is located, including:
if any difference value of the pairwise difference values of the second kinematic intensity of the four first sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic intensity of the four first sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic intensity of any two adjacent first sub-coding units and the sum of the second kinematic intensity of other two first sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the first sub-coding unit as SMP;
and if any difference value of the pairwise difference values of the second motion severity of the four first sub-coding units is smaller than or equal to a product of a mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1.
Optionally, the texture complexity MAD is calculated by the following formula:
Figure BDA0002261942800000041
wherein W is the width of the maximum coding unit, and H is the height of the maximum coding unit;
i is the abscissa of each pixel point in the maximum coding unit, and j is the ordinate of each pixel point in the maximum coding unit;
pixel (i, j) is the pixel value of the pixel point with the coordinate position (i, j);
ave is the average value of the pixel values of all the pixel points in the maximum coding unit.
A second aspect of an embodiment of the present invention provides an HEVC video inter-frame prediction apparatus, where an HEVC video includes multiple frames of continuously acquired images, and the apparatus includes:
the first calculation module is used for determining the texture complexity of the maximum coding unit according to the width and the height of each maximum coding unit in a current image and the pixel value of each pixel point in the maximum coding unit;
a comparison module, which determines that the split depth of the maximum coding unit is 0 or 1 if the texture complexity is less than or equal to a preset threshold; otherwise, determining the maximum coding unit partition depth to be 2 or 3;
a second calculating module, configured to calculate a first sporty severity of a first sub-coding unit corresponding to the split depth of 0 or 2 and a second sporty severity of each second sub-coding unit in four second sub-coding units of a next split depth corresponding to the first sub-coding unit;
the mode selection module stops continuously dividing the corresponding first sub-coding unit when the first kinematic severity is 0, and determines the inter-frame prediction mode of the first sub-coding unit as an SKIP/merge mode; when the first kinematic intensity is not 0, comparing the first kinematic intensity of the first sub-coding unit with the sum of the second kinematic intensities of four second sub-coding units corresponding to the first sub-coding unit; if the first kinematic severity of the first sub-coding unit is greater than the sum of the second kinematic severity of the four second sub-coding units corresponding to the first sub-coding unit, dividing the first sub-coding unit into four second sub-coding units of a next division depth, and determining an inter-frame prediction mode of the second sub-coding units according to the difference between the second kinematic severity of the four second sub-coding units of the next division depth; otherwise, stopping continuously dividing the corresponding first sub-coding units, and determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the division depth where the first sub-coding units are located.
Optionally, the calculating of the first and second sports intensity includes:
and determining the kinematic severity of each sub-coding unit under the corresponding division depth according to the width and height of each sub-coding unit under the corresponding division depth, the size of the corresponding division depth, the pixel value of each pixel point in each sub-coding unit under the corresponding division depth and the pixel value of each pixel point in the region of the previous frame image of the current image, which is at the same position as each sub-coding unit under the corresponding division depth.
Optionally, the sports severity FDdThe calculation formula of (2) is as follows:
Figure BDA0002261942800000061
wherein d is the corresponding segmentation depth;
Wdand HdRespectively the width and the height of the sub-coding unit under the corresponding segmentation depth d;
(x, y) is the relative position coordinates of the pixel points in each sub-coding unit;
Figure BDA0002261942800000062
the absolute coordinate position of each sub coding unit under the corresponding division depth d is the pixel value of (i, j);
Figure BDA0002261942800000063
and (3) the pixel value of the pixel point with the absolute coordinate position (i, j) at the corresponding segmentation depth in the previous frame image of the current image is obtained.
Optionally, when determining the inter prediction mode of the second sub-coding unit according to the difference between the second kinematic severity of the four second sub-coding units of the next partition depth, the mode selection module is specifically configured to:
if any difference value of the two-by-two difference values of the second kinematic intensity of the four second sub-coding units is larger than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the second sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic intensity of the four second sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic intensity of any two adjacent second sub-coding units and the sum of the second kinematic intensity of other two second sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the second sub-coding unit as SMP;
if any difference value of the pairwise difference values of the second motion severity of the four second sub-coding units is smaller than or equal to a product of a mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining an inter-frame prediction mode of the second sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1;
and/or the presence of a gas in the gas,
the mode selection module is specifically configured to, when determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the split depth where the first sub-coding unit is located:
if any difference value of the pairwise difference values of the second kinematic intensity of the four first sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic intensity of the four first sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic intensity of any two adjacent first sub-coding units and the sum of the second kinematic intensity of other two first sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the first sub-coding unit as SMP;
and if any difference value of the pairwise difference values of the second motion severity of the four first sub-coding units is smaller than or equal to a product of a mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1.
Optionally, the texture complexity MAD is calculated by the following formula:
Figure BDA0002261942800000081
wherein W is the width of the maximum coding unit, and H is the height of the maximum coding unit;
i is the abscissa of each pixel point in the maximum coding unit, and j is the ordinate of each pixel point in the maximum coding unit;
pixel (i, j) is the pixel value of the pixel point with the coordinate position (i, j);
ave is the average value of the pixel values of all the pixel points in the maximum coding unit.
According to the embodiment of the invention, the segmentation depth is determined through the texture complexity of the maximum coding unit, whether the next layer of depth division is continued or not is determined according to the motion severity of the sub-coding unit corresponding to each segmentation depth, and the inter-frame prediction mode is selected, so that the inter-frame coding speed of HEVC is greatly improved, the coding compression performance and the accuracy of prediction coding are ensured, and the problem that real-time coding cannot be performed due to the huge computation amount of the inter-frame prediction coding of HEVC is solved.
Drawings
FIG. 1 is a diagram illustrating a flow of inter-frame prediction function calls in the reference software HM12.0 in the prior art;
fig. 2 is a flowchart of a method of HEVC video inter-frame prediction according to an embodiment of the present invention;
FIG. 3 is a schematic diagram of partitioning a coding unit CU according to an embodiment of the present invention;
fig. 4 is a flowchart of a method for HEVC video inter-frame prediction according to an embodiment of the present invention;
fig. 5 is a block diagram of an HEVC video inter-prediction device according to an embodiment of the present invention.
Detailed Description
The main objective of the HEVC coding standard is to double the compression efficiency of high-resolution/high-fidelity video images on the basis of the h.264/AVC standard, that is, on the premise of ensuring the same video image quality, the code rate of a video stream is reduced by 50%, so as to better adapt to various different network environments, and the objective of improving the HEVC coding efficiency by 1 time has been achieved, but since a quadtree structure (quadtree structure) and a Larger Coding Unit (LCU) are used in a coding structure, the computational complexity of an encoder is significantly improved, the coding time cannot meet the real-time requirement, and the high-compression performance is obtained while the extremely high computational complexity is brought, which is obviously disadvantageous for the long-term development of the HEVC coding technology. Therefore, how to significantly reduce the amount of coding computation and increase the coding speed on the premise of preserving the compression efficiency and image quality of HEVC coding becomes especially important.
In the prior art, in order to improve compression efficiency, a coding unit CU in HEVC adopts quadtree recursive partitioning, and two major features of the CU are characterized by the size and Depth of the CU. The largest coding unit LCU is recursively split into 4 sub-units CUs in a quadtree, and then each sub-unit CUs is recursively split into 4 smaller coding units in a quadtree, until the smallest coding unit SCU, each split corresponds to one Depth, and each CU is further split into various prediction units PU and transform units TU. The prediction unit PU can be divided into intra and inter. The transform unit TU is also recursively divided in a quad tree, and has three sizes of 32 × 32, 16 × 16, and 8 × 8. Each LCU has coding depth from 0 to 3, and is recursively divided into CUs of 4 depths (sizes of 64 × 64, 32 × 32, 16 × 16, and 8 × 8, respectively) to form a quad-tree coding structure. For a CU at a certain depth d, the Inter prediction modes include SKIP/merge, Square split (Square, Inter 2N × 2N, Inter N × N), symmetric split (SMP, Inter 2N × N, Inter N × 2N), asymmetric split (AMP, Inter 2N × nU, Inter 2N × nD, Inter nL × 2N, Inter nR × 2N'), and intra modes (intra 2N × 2N, intra N).
The HEVC encoder performs motion estimation and motion compensation on all partitions (SKIP/merge, Square, SMP, AMP, and intra modes) from top to bottom for CUs at different depths, and the procedure of program invocation in the reference software HM is as shown in fig. 1, starting from LCU (coding depth d is 0) until the minimum coding unit SCU (coding depth d is 3) ends, and performs the function invocation flow in fig. 1 on the CUs at each layer depth, and compares the rate-distortion cost for each inter prediction mode one by one, and finds the PU partition with the smallest rate-distortion cost as the best PU prediction mode of the current CU. Obviously, the calculation complexity of the encoding end is very high in the traversal calculation process, the encoding time consumed by video compression is long, and the real-time video compression requirement cannot be met. Therefore, a large amount of operation complexity is introduced in the inter-frame prediction process of HEVC, and how to effectively reduce the operation amount of an encoder becomes a problem to be solved urgently at present.
Therefore, the invention provides an HEVC video inter-frame prediction method, which determines the segmentation depth through the texture complexity of the maximum coding unit, determines whether to continue to divide the depth of the next layer according to the kinematic severity of the sub-coding unit corresponding to each segmentation depth, and selects an inter-frame prediction mode, thereby greatly improving the HEVC inter-frame coding speed, ensuring the coding compression performance and the accuracy of prediction coding, and solving the problem that real-time coding cannot be performed due to the huge computation amount of HEVC inter-frame prediction coding.
The technical solutions in the embodiments of the present invention will be clearly and completely described below with reference to the drawings in the embodiments of the present invention, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all of the embodiments. All other embodiments, which can be derived by a person skilled in the art from the embodiments given herein without making any creative effort, shall fall within the protection scope of the present invention.
It should be noted that the following embodiments may be combined without conflict.
The HEVC video provided by the embodiment of the invention comprises multiple frames of continuously acquired images.
Referring to fig. 2, an HEVC video inter-frame prediction method according to an embodiment of the present invention may include the following steps:
s201: determining the texture complexity of the maximum coding unit according to the width and the height of each maximum coding unit in the current image and the pixel value of each pixel point in the maximum coding unit;
in this embodiment, the texture complexity is used to determine whether the texture of each maximum coding unit is smooth.
Optionally, the texture complexity MAD is calculated by the following formula:
Figure BDA0002261942800000101
in formula (1), W is the width of the maximum coding unit, and H is the height of the maximum coding unit; i is the abscissa of each pixel point in the maximum coding unit, and j is the ordinate of each pixel point in the maximum coding unit; pixel (i, j) is the pixel value of the pixel point with the coordinate position (i, j); ave is the average value of the pixel values of all the pixel points in the maximum coding unit.
It should be understood that the texture complexity MAD may be calculated in other manners.
S202: if the texture complexity is less than or equal to a preset threshold value, determining the segmentation depth of the maximum coding unit to be 0 or 1; otherwise, determining the maximum coding unit partition depth to be 2 or 3;
the texture complexity is less than or equal to the preset threshold, which indicates that the texture of the corresponding maximum coding unit is simpler and smoother, and the optimal segmentation is highly likely to be the size of 64 × 64 (corresponding to the segmentation depth of 0) and 32 × 32 (corresponding to the segmentation depth of 1); the texture complexity is greater than the predetermined threshold, indicating that the texture of the corresponding largest coding unit is more complex, and the probability of the optimal partition size is 16 × 16 (corresponding to the partition depth of 2) and 8 × 8 (corresponding to the partition depth of 3).
In one embodiment, the preset threshold is 16, and when the MAD is less than or equal to 16, the texture of the largest coding unit is smooth; when the MAD is larger than 16, the texture of the largest coding unit is more complicated.
S203: calculating a first kinematic intensity of a first sub-coding unit corresponding to the split depth of 0 or 2 and a second kinematic intensity of each second sub-coding unit in four second sub-coding units of a next split depth corresponding to the first sub-coding unit;
the method comprises the following steps that strong correlation exists between adjacent frames in a video on a time domain, the higher the frame rate is, the stronger the correlation is, residual error numerical values corresponding to smooth areas with small motion changes between corresponding Coding Units (CU) at the same positions of the two adjacent frames are distributed uniformly, and the trend of continuous depth division towards the next layer is weakened; in the region with severe motion, the residual error value has large fluctuation, and the method is suitable for processing by adopting a smaller CU size, namely the size of the CU has a close relation with the pixel residual error distribution of the CU at the same position of the adjacent frame.
Optionally, the calculating process of the first and second sports intensity includes: and determining the kinematic severity of each sub-coding unit under the corresponding segmentation depth according to the width and height of each sub-coding unit under the corresponding segmentation depth, the size of the corresponding segmentation depth, the pixel value of each pixel point in each sub-coding unit under the corresponding segmentation depth and the pixel value of each pixel point in the region of the previous frame image of the current image, which is at the same position as each sub-coding unit under the corresponding segmentation depth.
For example, the motion severity FD of a CU of depth ddThe calculation formula of (2) is as follows:
Figure BDA0002261942800000121
in the formula (2), d is the corresponding segmentation depth and belongs to [0,3 ]]；WdAnd HdRespectively the width and the height of the sub-coding unit under the corresponding segmentation depth d; (x, y) is the relative position coordinates of the pixel points in each sub-coding unit;
Figure BDA0002261942800000122
the absolute coordinate position of each sub coding unit under the corresponding division depth d is the pixel value of (i, j);
Figure BDA0002261942800000123
and (3) the pixel value of the pixel point with the absolute coordinate position (i, j) at the corresponding segmentation depth in the previous frame image of the current image is taken as the pixel value of the pixel point.
FDdReflecting the degree of difference of each data value in the residual error, FD is used for CU at a certain depth ddThe smaller the residual distribution, the more uniform the residual distribution, and the smaller the tendency to continue to the next level of depth segmentation. If FD of the current CUdThe value is small, and the difference between the current CU and the previous frame CU in texture and motion changes is considered to be small, and the similarity between the two CUs is large.
S204: when the first kinematic severity is 0, stopping continuously dividing the corresponding first sub-coding unit, and determining the inter-frame prediction mode of the first sub-coding unit as an SKIP/merge mode;
the SKIP mode is a SKIP prediction mode, the merge mode is a merge prediction mode, both of the two inter prediction modes are the existing inter prediction modes, and the two inter prediction modes are not specifically described in this embodiment.
After the depth of each CU is determined, inter prediction mode determination needs to be performed on the CU at the current depth, so that unnecessary mode determination processes are reduced, and the coding efficiency is further improved. In the inter-frame prediction process, a CU in a uniform background area is usually small in coding depth, the prediction mode is relatively simple, and the modes such as SKIP/merge mode, inter 2N × 2N and the like are large in specific gravity; and the CU in a severe motion area has larger coding depth and more various corresponding prediction modes, wherein the proportion of SMP, AMP and intra modes is increased. The inter-frame prediction mode type of the current block to be coded is closely related to the motion characteristics of the block, and the more complex the motion intensity in the video is, the more abundant the inter-frame prediction mode types are needed.
In this embodiment, FD is calculated in the largest coding unit LCU with a partition depth d equal to 00When the current LCU is equal to 0, it is determined that the current LCU is substantially identical to the LCU of the adjacent frame, the subsequent sub-coding unit division process can be directly skipped, and the inter-prediction mode of the current LCU is determined to be SKIP/merge mode.
S205: when the first kinematic severity is not 0, comparing the first kinematic severity of the first sub-coding unit with the sum of the second kinematic severity of four second sub-coding units corresponding to the first sub-coding unit;
in this embodiment, for a CU with d equal to 0 or 2, the first sporty severity FD of each CU is setdFD of four sub-CUs corresponding to the CUd+1Comparing with the above, referring to fig. 3, each CU continues to be further divided into four sub-CUs, namely, leftup, rightup, leftdown, and rightdown, in the present embodiment, FD is compareddAnd
Figure BDA0002261942800000131
s206: if the first kinematic severity of the first sub-coding unit is larger than the sum of the second kinematic severity of the four second sub-coding units corresponding to the first sub-coding unit, dividing the first sub-coding unit into four second sub-coding units with next division depth, and determining the inter-frame prediction mode of the second sub-coding units according to the difference between the second kinematic severity of the four second sub-coding units with next division depth; otherwise, stopping continuously dividing the corresponding first sub-coding units, and determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the division depth where the first sub-coding units are located.
Optionally, determining the inter prediction mode of the second sub-coding unit according to the difference between the second kinematic intensity of the four second sub-coding units of the next split depth includes: if any difference value of the second motion intensity of the four second sub-coding units is larger than the product of the mean value of the second motion intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the second sub-coding unit as AMP; if any difference value of the pairwise difference values of the second kinematic severity of the four second sub-coding units is greater than the product of the mean value of the second kinematic severity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic severity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic severity of any two adjacent second sub-coding units and the sum of the second kinematic severity of other two second sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the second sub-coding unit as SMP; and if any difference value of the pairwise difference values of the second motion severity of the four second sub-coding units is smaller than or equal to the product of the mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining the inter-frame prediction mode of the second sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1. The Square mode is a Square prediction mode, the intra modes are intra prediction modes, both of the two inter prediction modes are the existing inter prediction modes, and the two inter prediction modes are not specifically described in this embodiment.
Determining an inter-frame prediction mode of a first sub-coding unit according to a difference between first kinematic severity of four first sub-coding units of a split depth where the first sub-coding unit is located, including: if any difference value of the two-by-two difference values of the second kinematic intensity of the four first sub-coding units is larger than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as AMP; if any difference value of the pairwise difference values of the second kinematic severity of the four first sub-coding units is greater than the product of the mean value of the second kinematic severity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic severity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic severity of any two adjacent first sub-coding units and the sum of the second kinematic severity of other two first sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the first sub-coding unit as SMP; and if any difference value of the pairwise difference values of the second motion severity of the four first sub-coding units is smaller than or equal to the product of the mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1. Wherein, the AMP mode is asymmetric division, and English of the AMP is called as symmetric motion partitioning; the SMP mode is a symmetric partition mode, all english language of the SMP is called symmetry motion prediction, both of the two inter-frame prediction modes are the existing inter-frame prediction modes, and the two inter-frame prediction modes are not specifically described in this embodiment.
Optionally, the first predetermined factor is 50% and the second predetermined factor is 20%.
Referring to FIG. 4, if FD of 4 sub-CU's of current CUd+1Difference between sizes is more than 50%, and FD of 4 sub-coding unitsd+1The sum is greater than the FD of the current CUdThen the partition is terminated, inter prediction and coding are performed at the depth d of the current CU, and the inter prediction mode is selected to be AMP. Wherein FD of 4 sub-coding units of the current CUd+1Differences between sizes of more than 50% refer to:
Figure BDA0002261942800000151
Figure BDA0002261942800000152
any one of the six difference values is greater than FD of 4 sub-coding units of the current CUd+1Mean value of (AFD)d+1And a product of 50%, wherein,
Figure BDA0002261942800000153
FD if 4 sub-coding units of current CUd+1Difference between sizes exceeds 20%, and FD of 4 sub-coding unitsd+1The sum is greater than the FD of the current CUdIf the segmentation is ended, performing inter-frame prediction and coding according to the depth d of the current CU; the formulas (3) and (4) are reused for FD of the four sub-coding unitsd+1And after the relation between the two modes is compared, selecting a prediction mode:
Figure BDA0002261942800000154
Figure BDA0002261942800000155
if expression (3) or (4) is satisfied, the inter prediction mode is selected to be SMP.
If not (3) or (4), entering FD of the current 4 sub-coding unitsd+1The sum is greater than the FD of the current CUdAnd the difference between the sub-coding units is not large.
Wherein FD of 4 sub-coding units of the current CUd+1Differences between sizes of more than 20% mean:
Figure BDA0002261942800000161
Figure BDA0002261942800000162
any one of the six difference values is greater than FD of 4 sub-coding units of the current CUd+1Mean value of (AFD)d+1And 20%, and all difference values are less than or equal to FD of 4 sub-coding units of the current CUd+1Mean value of (AFD)d+1And 50%.
FD if the current 4 sub-coding unitsd+1The sum is greater than the FD of the current CUdAnd sub-codingIf the difference between the units is not large, the segmentation is terminated, and inter-frame prediction and coding are carried out according to the depth d of the current CU; the prediction mode is selected as Square, intra modes. Wherein FD of 4 sub-coding units of the current CUd+1The small difference between the sizes means that:
Figure BDA0002261942800000163
Figure BDA0002261942800000164
all of the six difference values are less than FD of 4 sub-coding units of the current CUd+1Mean value of (AFD)d+1And 20%.
FD if 4 sub-coding unitsd+1The sum is less than the FD of the current CUdThen the CU is divided and inter prediction and coding are performed using the next level d + 1. And jumping to S203 to process each sub-coding unit in turn until the current CU depth reaches the maximum value of 3, and ending the division.
Corresponding to the HEVC inter-frame prediction method in the above embodiments, an embodiment of the present invention further provides an HEVC video inter-frame prediction apparatus, please refer to fig. 5, which may include a first calculating module 110, a comparing module 120, a second calculating module 130, and a mode selecting module 140.
The first calculating module 110 is configured to determine the texture complexity of the maximum coding unit according to the width and height of each maximum coding unit in the current image and the pixel value of each pixel point in the maximum coding unit.
The comparing module 120 determines that the split depth of the largest coding unit is 0 or 1 if the texture complexity is less than or equal to a preset threshold; otherwise, the maximum coding unit split depth is determined to be 2 or 3.
The second calculating module 130 is configured to calculate a first sporty severity of a first sub-coding unit corresponding to a split depth of 0 or 2 and a second sporty severity of each second sub-coding unit in four second sub-coding units of a next split depth corresponding to the first sub-coding unit.
The mode selection module 140 stops continuously dividing the corresponding first sub-coding unit when the first sports severity is 0, and determines the inter-frame prediction mode of the first sub-coding unit as the SKIP/merge mode; when the first kinematic severity is not 0, comparing the first kinematic severity of the first sub-coding unit with the sum of the second kinematic severity of four second sub-coding units corresponding to the first sub-coding unit; if the first kinematic severity of the first sub-coding unit is larger than the sum of the second kinematic severity of the four second sub-coding units corresponding to the first sub-coding unit, dividing the first sub-coding unit into four second sub-coding units with next division depth, and determining the inter-frame prediction mode of the second sub-coding units according to the difference between the second kinematic severity of the four second sub-coding units with next division depth; otherwise, stopping continuously dividing the corresponding first sub-coding units, and determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the division depth where the first sub-coding units are located.
Optionally, the calculating process of the first and second sports intensity includes:
and determining the kinematic severity of each sub-coding unit under the corresponding segmentation depth according to the width and height of each sub-coding unit under the corresponding segmentation depth, the size of the corresponding segmentation depth, the pixel value of each pixel point in each sub-coding unit under the corresponding segmentation depth and the pixel value of each pixel point in the region of the previous frame image of the current image, which is at the same position as each sub-coding unit under the corresponding segmentation depth.
Optionally, sports severity FDdThe calculation formula of (2) is as follows:
Figure BDA0002261942800000171
wherein d is the corresponding segmentation depth;
Wdand HdRespectively the width and the height of the sub-coding unit under the corresponding segmentation depth d;
(x, y) is the relative position coordinates of the pixel points in each sub-coding unit;
Figure BDA0002261942800000181
the absolute coordinate position of each sub coding unit under the corresponding division depth d is the pixel value of (i, j);
Figure BDA0002261942800000182
and (3) the pixel value of the pixel point with the absolute coordinate position (i, j) at the corresponding segmentation depth in the previous frame image of the current image is taken as the pixel value of the pixel point.
Optionally, the mode selection module 140 is specifically configured to, when determining the inter prediction mode of the second sub-coding unit according to the difference between the second kinematic severity of the four second sub-coding units at the next partition depth:
if any difference value of the second motion intensity of the four second sub-coding units is larger than the product of the mean value of the second motion intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the second sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic severity of the four second sub-coding units is greater than the product of the mean value of the second kinematic severity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic severity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic severity of any two adjacent second sub-coding units and the sum of the second kinematic severity of other two second sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the second sub-coding unit as SMP;
if any difference value of the pairwise difference values of the second motion severity of the four second sub-coding units is smaller than or equal to the product of the mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining the inter-frame prediction mode of the second sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1; and/or the presence of a gas in the gas,
the mode selection module 140 is specifically configured to, when determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the split depth where the first sub-coding unit is located:
if any difference value of the two-by-two difference values of the second kinematic intensity of the four first sub-coding units is larger than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic severity of the four first sub-coding units is greater than the product of the mean value of the second kinematic severity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic severity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic severity of any two adjacent first sub-coding units and the sum of the second kinematic severity of other two first sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the first sub-coding unit as SMP;
and if any difference value of the pairwise difference values of the second motion severity of the four first sub-coding units is smaller than or equal to the product of the mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1.
Optionally, the texture complexity MAD is calculated by the following formula:
Figure BDA0002261942800000191
wherein, W is the width of the maximum coding unit, and H is the height of the maximum coding unit;
i is the abscissa of each pixel point in the maximum coding unit, and j is the ordinate of each pixel point in the maximum coding unit;
pixel (i, j) is the pixel value of the pixel point with the coordinate position (i, j);
ave is the average value of the pixel values of all the pixel points in the maximum coding unit.
The above examples are only intended to illustrate the technical solution of the present invention, but not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it will be understood by those of ordinary skill in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; and such modifications or substitutions do not depart from the spirit and scope of the corresponding technical solutions of the embodiments of the present invention.

Claims (8)

1. An HEVC video inter-frame prediction method, wherein the HEVC video comprises a plurality of frames of continuously acquired images, the method comprising:
determining the texture complexity of the maximum coding unit according to the width and the height of each maximum coding unit in the current image and the pixel value of each pixel point in the maximum coding unit;
if the texture complexity is smaller than or equal to a preset threshold value, determining that the segmentation depth of the maximum coding unit is 0 or 1; otherwise, determining the maximum coding unit partition depth to be 2 or 3;
calculating a first kinematic severity of a first sub-coding unit corresponding to the split depth of 0 or 2 and a second kinematic severity of each of four second sub-coding units of a next split depth corresponding to the first sub-coding unit;
when the first kinematic severity is 0, stopping continuously dividing the corresponding first sub-coding unit, and determining the inter-frame prediction mode of the first sub-coding unit as an SKIP/merge mode;
when the first kinematic intensity is not 0, comparing the first kinematic intensity of the first sub-coding unit with the sum of the second kinematic intensities of four second sub-coding units corresponding to the first sub-coding unit;
if the first kinematic severity of the first sub-coding unit is greater than the sum of the second kinematic severity of the four second sub-coding units corresponding to the first sub-coding unit, dividing the first sub-coding unit into four second sub-coding units of a next division depth, and determining an inter-frame prediction mode of the second sub-coding units according to the difference between the second kinematic severity of the four second sub-coding units of the next division depth; otherwise, stopping continuously dividing the corresponding first sub-coding units, and determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the division depth where the first sub-coding units are located;
determining an inter prediction mode of the second sub-coding unit according to a difference between second kinematic severity of four second sub-coding units of the next division depth, including:
if any difference value of the two-by-two difference values of the second kinematic intensity of the four second sub-coding units is larger than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the second sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic intensity of the four second sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic intensity of any two adjacent second sub-coding units and the sum of the second kinematic intensity of other two second sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the second sub-coding unit as SMP;
if any difference value of the pairwise difference values of the second motion severity of the four second sub-coding units is smaller than or equal to a product of a mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining an inter-frame prediction mode of the second sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1;
and/or, the determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the split depth where the first sub-coding unit is located includes:
if any difference value of the pairwise difference values of the second kinematic intensity of the four first sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic intensity of the four first sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic intensity of any two adjacent first sub-coding units and the sum of the second kinematic intensity of other two first sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the first sub-coding unit as SMP;
and if any difference value of the pairwise difference values of the second motion severity of the four first sub-coding units is smaller than or equal to a product of a mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1.
2. An HEVC video inter-frame prediction method according to claim 1 wherein said process of calculating said first and second motion severity comprises:
and determining the kinematic severity of each sub-coding unit under the corresponding division depth according to the width and height of each sub-coding unit under the corresponding division depth, the size of the corresponding division depth, the pixel value of each pixel point in each sub-coding unit under the corresponding division depth and the pixel value of each pixel point in the region of the previous frame image of the current image, which is at the same position as each sub-coding unit under the corresponding division depth.
3. HEVC video inter-frame prediction method according to claim 2, wherein said motion severity FDdThe calculation formula of (2) is as follows:
Figure FDA0003356356150000031
wherein d is the corresponding segmentation depth;
Wdand HdRespectively the width and the height of the sub-coding unit under the corresponding segmentation depth d;
(x, y) is the relative position coordinates of the pixel points in each sub-coding unit;
Figure FDA0003356356150000032
the absolute coordinate position of each sub coding unit under the corresponding division depth d is the pixel value of (i, j);
Figure FDA0003356356150000033
and (3) the pixel value of the pixel point with the absolute coordinate position (i, j) at the corresponding segmentation depth in the previous frame image of the current image is obtained.
4. An HEVC video inter-frame prediction method according to claim 1 wherein the texture complexity MAD is calculated by the formula:
Figure FDA0003356356150000041
wherein W is the width of the maximum coding unit, and H is the height of the maximum coding unit;
i is the abscissa of each pixel point in the maximum coding unit, and j is the ordinate of each pixel point in the maximum coding unit;
pixel (i, j) is the pixel value of the pixel point with the coordinate position (i, j);
ave is the average value of the pixel values of all the pixel points in the maximum coding unit.
5. An HEVC video inter-frame prediction device, wherein the HEVC video comprises a plurality of frames of continuously acquired images, the device comprises:
the first calculation module is used for determining the texture complexity of the maximum coding unit according to the width and the height of each maximum coding unit in a current image and the pixel value of each pixel point in the maximum coding unit;
a comparison module, which determines that the split depth of the maximum coding unit is 0 or 1 if the texture complexity is less than or equal to a preset threshold; otherwise, determining the maximum coding unit partition depth to be 2 or 3;
a second calculating module, configured to calculate a first sporty severity of a first sub-coding unit corresponding to the split depth of 0 or 2 and a second sporty severity of each second sub-coding unit in four second sub-coding units of a next split depth corresponding to the first sub-coding unit;
the mode selection module stops continuously dividing the corresponding first sub-coding unit when the first kinematic severity is 0, and determines the inter-frame prediction mode of the first sub-coding unit as an SKIP/merge mode; when the first kinematic intensity is not 0, comparing the first kinematic intensity of the first sub-coding unit with the sum of the second kinematic intensities of four second sub-coding units corresponding to the first sub-coding unit; if the first kinematic severity of the first sub-coding unit is greater than the sum of the second kinematic severity of the four second sub-coding units corresponding to the first sub-coding unit, dividing the first sub-coding unit into four second sub-coding units of a next division depth, and determining an inter-frame prediction mode of the second sub-coding units according to the difference between the second kinematic severity of the four second sub-coding units of the next division depth; otherwise, stopping continuously dividing the corresponding first sub-coding units, and determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the division depth where the first sub-coding units are located;
the mode selection module is specifically configured to, when determining the inter-frame prediction mode of the second sub-coding unit according to the difference between the second kinematic severity of the four second sub-coding units of the next division depth:
if any difference value of the two-by-two difference values of the second kinematic intensity of the four second sub-coding units is larger than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the second sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic intensity of the four second sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic intensity of any two adjacent second sub-coding units and the sum of the second kinematic intensity of other two second sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the second sub-coding unit as SMP;
if any difference value of the pairwise difference values of the second motion severity of the four second sub-coding units is smaller than or equal to a product of a mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining an inter-frame prediction mode of the second sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1;
and/or the presence of a gas in the gas,
the mode selection module is specifically configured to, when determining the inter-frame prediction mode of the first sub-coding unit according to the difference between the first kinematic severity of the four first sub-coding units of the split depth where the first sub-coding unit is located:
if any difference value of the pairwise difference values of the second kinematic intensity of the four first sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as AMP;
if any difference value of the pairwise difference values of the second kinematic intensity of the four first sub-coding units is greater than the product of the mean value of the second kinematic intensity of the four second sub-coding units and a second preset coefficient and is less than or equal to the product of the mean value of the second kinematic intensity of the four second sub-coding units and a first preset coefficient, and the sum of the second kinematic intensity of any two adjacent first sub-coding units and the sum of the second kinematic intensity of other two first sub-coding units are greater than a preset multiple, determining the inter-frame prediction mode of the first sub-coding unit as SMP;
and if any difference value of the pairwise difference values of the second motion severity of the four first sub-coding units is smaller than or equal to a product of a mean value of the second motion severity of the four second sub-coding units and a second preset coefficient, determining the inter-frame prediction mode of the first sub-coding unit as a Square or intra mode, wherein the first preset coefficient is larger than the second preset coefficient, and the first preset coefficient and the second preset coefficient are both larger than 0 and smaller than 1.
6. HEVC video inter-frame prediction apparatus according to claim 5, wherein said process of calculating said first and second motion severity comprises:
and determining the kinematic severity of each sub-coding unit under the corresponding division depth according to the width and height of each sub-coding unit under the corresponding division depth, the size of the corresponding division depth, the pixel value of each pixel point in each sub-coding unit under the corresponding division depth and the pixel value of each pixel point in the region of the previous frame image of the current image, which is at the same position as each sub-coding unit under the corresponding division depth.
7. HEVC video inter-frame prediction device according to claim 6, wherein said motion severity FDdThe calculation formula of (2) is as follows:
Figure FDA0003356356150000061
wherein d is the corresponding segmentation depth;
Wdand HdRespectively the width and the height of the sub-coding unit under the corresponding segmentation depth d;
(x, y) is the relative position coordinates of the pixel points in each sub-coding unit;
Figure FDA0003356356150000071
the absolute coordinate position of each sub coding unit under the corresponding division depth d is the pixel value of (i, j);
Figure FDA0003356356150000072
and (3) the pixel value of the pixel point with the absolute coordinate position (i, j) at the corresponding segmentation depth in the previous frame image of the current image is obtained.
8. HEVC video inter-frame prediction apparatus according to claim 5, wherein said texture complexity MAD is calculated by:
Figure FDA0003356356150000073
wherein W is the width of the maximum coding unit, and H is the height of the maximum coding unit;
i is the abscissa of each pixel point in the maximum coding unit, and j is the ordinate of each pixel point in the maximum coding unit;
pixel (i, j) is the pixel value of the pixel point with the coordinate position (i, j);
ave is the average value of the pixel values of all the pixel points in the maximum coding unit.
CN201911074393.XA 2019-11-06 2019-11-06 HEVC video inter-frame prediction method and device Active CN110933410B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911074393.XA CN110933410B (en) 2019-11-06 2019-11-06 HEVC video inter-frame prediction method and device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911074393.XA CN110933410B (en) 2019-11-06 2019-11-06 HEVC video inter-frame prediction method and device

Publications (2)

Publication Number Publication Date
CN110933410A CN110933410A (en) 2020-03-27
CN110933410B true CN110933410B (en) 2022-03-25

Family

ID=69852447

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911074393.XA Active CN110933410B (en) 2019-11-06 2019-11-06 HEVC video inter-frame prediction method and device

Country Status (1)

Country Link
CN (1) CN110933410B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104113754A (en) * 2014-07-17 2014-10-22 四川大学 Method for high-performance video interframe coding based on time domain relevance and transcoder thereof
CN105812797A (en) * 2014-12-31 2016-07-27 浙江大华技术股份有限公司 Coding unit selection method and device
CN106961606A (en) * 2017-01-26 2017-07-18 浙江工业大学 The HEVC intra-frame encoding mode systems of selection of feature are divided based on texture
CN107071496A (en) * 2017-05-14 2017-08-18 北京工业大学 A kind of H.265/HEVC interframe encode unit depth fast selecting method
CN108322747A (en) * 2018-01-05 2018-07-24 中国软件与技术服务股份有限公司 A kind of coding unit Partitioning optimization method towards ultra high-definition video

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR101457894B1 (en) * 2009-10-28 2014-11-05 삼성전자주식회사 Method and apparatus for encoding image, and method and apparatus for decoding image

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104113754A (en) * 2014-07-17 2014-10-22 四川大学 Method for high-performance video interframe coding based on time domain relevance and transcoder thereof
CN105812797A (en) * 2014-12-31 2016-07-27 浙江大华技术股份有限公司 Coding unit selection method and device
CN106961606A (en) * 2017-01-26 2017-07-18 浙江工业大学 The HEVC intra-frame encoding mode systems of selection of feature are divided based on texture
CN107071496A (en) * 2017-05-14 2017-08-18 北京工业大学 A kind of H.265/HEVC interframe encode unit depth fast selecting method
CN108322747A (en) * 2018-01-05 2018-07-24 中国软件与技术服务股份有限公司 A kind of coding unit Partitioning optimization method towards ultra high-definition video

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
数字视频的HEVC编码快速算法的研究;冯磊;《中国博士学位论文全文数据库（电子期刊）》;20160815;第4章 *

Also Published As

Publication number Publication date
CN110933410A (en) 2020-03-27

Similar Documents

Publication Publication Date Title
CN110087087B (en) VVC inter-frame coding unit prediction mode early decision and block division early termination method
US10313692B2 (en) Visual perception characteristics-combining hierarchical video coding method
US10003792B2 (en) Video encoder for images
CN109302610B (en) Fast coding method for screen content coding interframe based on rate distortion cost
JP5792305B2 (en) Method and apparatus for adaptive loop filtering
US11070803B2 (en) Method and apparatus for determining coding cost of coding unit and computer-readable storage medium
CN103517069A (en) HEVC intra-frame prediction quick mode selection method based on texture analysis
US20150208094A1 (en) Apparatus and method for determining dct size based on transform depth
CN105141954A (en) HEVC interframe coding quick mode selection method
WO2020248715A1 (en) Coding management method and apparatus based on high efficiency video coding
Chen et al. Rough mode cost–based fast intra coding for high-efficiency video coding
CN111586405B (en) Prediction mode rapid selection method based on ALF filtering in multifunctional video coding
CN109302616A (en) A kind of HEVC Inter Prediction High-speed Algorithm based on RC prediction
Yang et al. Fast intra encoding decisions for high efficiency video coding standard
KR100910209B1 (en) Apparatus and Method for the fast full search motion estimation using the partitioned search window
CN109889838B (en) HEVC (high efficiency video coding) rapid coding method based on ROI (region of interest)
CN106878754B (en) A kind of 3D video depth image method for choosing frame inner forecast mode
Chen et al. A fast inter coding algorithm for HEVC based on texture and motion quad-tree models
CN110933410B (en) HEVC video inter-frame prediction method and device
CN109547798B (en) Rapid HEVC inter-frame mode selection method
CN109089115B (en) Method for encoding 360-degree video in HEVC
KR20190062284A (en) Method and apparatus for image processing based on perceptual characteristic
Duvar et al. Fast inter mode decision exploiting intra-block similarity in HEVC
CN114827606A (en) Quick decision-making method for coding unit division
CN109168000B (en) HEVC intra-frame prediction rapid algorithm based on RC prediction

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant