CN111586406B - VVC intra-frame inter-frame skipping method, system, equipment and storage medium - Google Patents

VVC intra-frame inter-frame skipping method, system, equipment and storage medium Download PDF

Info

Publication number
CN111586406B
CN111586406B CN202010339113.XA CN202010339113A CN111586406B CN 111586406 B CN111586406 B CN 111586406B CN 202010339113 A CN202010339113 A CN 202010339113A CN 111586406 B CN111586406 B CN 111586406B
Authority
CN
China
Prior art keywords
prediction mode
intra
inter
frame
vvc
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010339113.XA
Other languages
Chinese (zh)
Other versions
CN111586406A (en
Inventor
张昊
马学睿
李�诚
钟培雄
冯冰雪
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Central South University
Original Assignee
Central South University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Central South University filed Critical Central South University
Priority to CN202010339113.XA priority Critical patent/CN111586406B/en
Publication of CN111586406A publication Critical patent/CN111586406A/en
Application granted granted Critical
Publication of CN111586406B publication Critical patent/CN111586406B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/103—Selection of coding mode or of prediction mode
    • H04N19/107—Selection of coding mode or of prediction mode between spatial and temporal predictive coding, e.g. picture refresh
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124—Quantisation
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/157—Assigned coding mode, i.e. the coding mode being predefined or preselected to be further used for selection of another element or parameter
    • H04N19/159—Prediction type, e.g. intra-frame, inter-frame or bidirectional frame prediction
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/40—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using video transcoding, i.e. partial or full decoding of a coded input stream followed by re-encoding of the decoded output stream
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/44—Decoders specially adapted therefor, e.g. video decoders which are asymmetric with respect to the encoder
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70—Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards

Abstract

The invention discloses a VVC intraframe interframe skipping method, a system, equipment and a storage medium, wherein the method comprises the following steps: encoding the input code stream by an encoder except VVC to obtain the intra-frame prediction mode RD-cost information of the CU block and the RD-cost information of the inter-frame prediction mode; and acquiring a difference value between the RD-cost of the intra-frame prediction mode corresponding to the current CU block position and the RD-cost of the inter-frame prediction mode, and determining the VVC-coded prediction mode of the current CU block. The invention can accurately predict the prediction mode of the CU block in the VVC coding by utilizing the RD-cost information of the intra-frame prediction mode and the RD-cost information of the inter-frame prediction mode of the CU block obtained by other video standards, thereby achieving the purposes of reducing the coding complexity of the VVC and improving the transcoding efficiency.

Description

VVC intra-frame inter-frame skipping method, system, equipment and storage medium
Technical Field
The present invention relates to the field of video coding technologies, and in particular, to a method, a system, a device, and a storage medium for skipping inter-frames in a VVC frame.
Background
Currently, due to the increasingly common use of High quality and High resolution Video, there is an urgent need to develop a next generation Video Coding technique that exceeds the current High Efficiency Video Coding (HEVC) standard. To solve this problem, moving Picture experts group (
Figure GDA0003160027800000011
Moving Picture epoch Group) and video coding experts Group (VCEG: VideoCoding epoch Group) jointly form a joint video exploration Group (jfet: joint Video augmentation Team) and recently gained weightA big progress. At the tenth jfet conference, jfet defined the first draft of multifunctional video coding (VVC) and the VVC test model 1(VTM1) encoding method. A coding partitioning framework is greatly changed in VVC, and a binary tree and a ternary tree partitioning are introduced on the basis of HEVC quadtree partitioning. The concept of CU, PU and TU in HEVC is eliminated in VVC, and the concept of Coding Unit (CU) is adopted uniformly. Furthermore, VVCs add a large number of tools in intra-prediction as well as inter-prediction, which results in a drastic increase in complexity of the prediction process of VVCs during encoding.
Meanwhile, various video coding standards coexist in the market at present, and the video coding standards such as AVS, AV2, MPEG-X, H.26X and the like are applied respectively. Format conversion, i.e., transcoding, between various video coding standards has become an indispensable technique. The transcoding framework between existing video standards today transcodes from h.264 to h.265 as shown in fig. 1, for example. Firstly, the input code stream is decoded by an H.264/AVC decoder. The method comprises the steps of obtaining a reconstructed video through decoding, inputting the reconstructed video into an HEVC/H.265 encoder as a source to generate a new code stream, wherein the HEVC/H.265 encoder can generate RD-cost intermediate information comprising an inter-frame prediction mode and RD-cost intermediate information comprising an intra-frame prediction mode when encoding the reconstructed video, and the intermediate information is obtained during encoding and used for not writing in a final code stream after comparing the sizes.
The traditional transcoding technology only utilizes decoding information of one video standard to accelerate another video standard, and the limitation of the information and the large difference of the coding standards lead to the undesirable acceleration effect. In addition, because of introducing a large number of intra-prediction and inter-prediction tools, the complexity of the whole prediction process is increased sharply, and the optimal prediction mode selection criteria for VVC coding are as follows: firstly, executing an inter-frame prediction mode, calculating RD-cost (rate distortion cost) of the inter-frame prediction mode, secondly, executing an intra-frame prediction mode, calculating RD-cost of the intra-frame prediction mode, then comparing the RD-cost of the inter-frame prediction mode with the RD-cost of the intra-frame prediction mode, and selecting a mode with smaller RD-cost as an optimal prediction mode. However, the complexity of the intra-frame and inter-frame prediction process of the VVC is high and the encoding time is long at present, so that the complexity of the intra-frame and inter-frame prediction process of the VVC is reduced and the transcoding efficiency is improved.
Disclosure of Invention
The present invention is directed to solving at least one of the problems of the prior art. Therefore, the invention provides a VVC intra-frame inter-frame skipping method, system, device and storage medium, which can reduce the encoding complexity of VVC and improve the transcoding efficiency.
The embodiment of the invention provides a VVC intraframe interframe skipping method, which comprises the following steps:
encoding the input code stream by an encoder except VVC to obtain the intra-frame prediction mode RD-cost information of the CU block and the RD-cost information of the inter-frame prediction mode;
and acquiring a difference value between the RD-cost of the intra-frame prediction mode corresponding to the current CU block position and the RD-cost of the inter-frame prediction mode, and determining the VVC-coded prediction mode of the current CU block.
According to the embodiment of the invention, at least the following technical effects are achieved:
the method can accurately predict the prediction mode of the CU block in the VVC coding by utilizing the RD-cost information of the intra-frame prediction mode and the RD-cost information of the inter-frame prediction mode of the CU block obtained by other video standards, thereby achieving the purposes of reducing the coding complexity of the VVC and improving the transcoding efficiency.
According to some embodiments of the present invention, the obtaining a difference between RD-cost of the intra prediction mode corresponding to the current CU block location and RD-cost of the inter prediction mode, determining the prediction mode of the VVC coding of the current CU block, comprises:
recording RD-cost of the intra prediction mode as JintraRD-cost of the inter prediction mode is denoted as Jinter；
If Jintra>JinterAnd satisfies the following conditions:
Figure GDA0003160027800000031
generating an intra prediction mode skip flag; if Jintra<JinterAnd satisfies the following conditions:
Figure GDA0003160027800000032
generating an inter prediction mode skip flag, wherein TRatioIs a threshold value;
and according to the intra-frame prediction mode skip identification or the inter-frame prediction mode skip identification, performing intra-frame prediction mode skip operation or inter-frame prediction mode skip operation on the VVC-coded current CU block.
According to some embodiments of the invention, the threshold T isRatioComprises the steps of:
and (3) calculating:
Figure GDA0003160027800000033
wherein R ismaxR is greater of RD-cost representing the intra prediction mode and RD-cost representing the inter prediction modeminThe lesser of the RD-cost representing the intra-prediction mode and the RD-cost representing the inter-prediction mode;
fitting the Proport and the QP value to generate the threshold value TRatioWherein, QP is a quantization parameter input when encoding the input code stream.
According to some embodiments of the invention, the encoder other than the VVC comprises: HEVC, AV1, AVs, VP9, or h.264 encoders.
An embodiment of the present invention provides a VVC intra frame inter frame skipping system, including: a first encoder module and a VVC encoder module;
the first encoder module is used for encoding an input code stream to obtain the intra-frame prediction mode RD-cost information of the CU block and the RD-cost information of the inter-frame prediction mode;
and the VVC encoder module is used for acquiring a difference value between the RD-cost of the intra-frame prediction mode corresponding to the current CU block position and the RD-cost of the inter-frame prediction mode, and determining the prediction mode of the current CU block.
According to the embodiment of the invention, at least the following technical effects are achieved:
the system can accurately predict the prediction mode of the CU blocks in the VVC by utilizing the RD-cost information of the intra-frame prediction mode and the RD-cost information of the inter-frame prediction mode of each CU block obtained by other video standards, thereby achieving the purposes of reducing the encoding complexity of the VVC and improving the transcoding efficiency.
An embodiment of the present invention provides a VVC intraframe interframe optimization apparatus, including: at least one control processor and a memory for communicative connection with the at least one control processor; the memory stores instructions executable by the at least one control processor to enable the at least one control processor to perform a VVC intra frame inter frame skip method as described above.
Embodiments of the present invention provide a computer-readable storage medium storing computer-executable instructions for causing a computer to perform a VVC intra frame inter frame skipping method as described above.
The VVC intraframe interframe optimization equipment and the readable storage medium provided by the embodiment of the invention can achieve the same beneficial effects as the method.
Additional aspects and advantages of the invention will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the invention.
Drawings
The above and/or additional aspects and advantages of the present invention will become apparent and readily appreciated from the following description of the embodiments, taken in conjunction with the accompanying drawings of which:
fig. 1 is a schematic structural diagram of a conventional video transcoding framework in the prior art;
fig. 2 is a flowchart illustrating a VVC intra frame inter frame skipping method according to an embodiment of the present invention;
fig. 3 is a flowchart illustrating a VVC intra frame inter frame skipping method according to an embodiment of the present invention;
FIG. 4 shows QP and threshold TratioSchematic diagram of fitting relationship of (1);
fig. 5 is a schematic structural diagram of a VVC intra frame inter frame skipping system according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a VVC intra frame inter frame skipping apparatus according to an embodiment of the present invention.
Detailed Description
Reference will now be made in detail to embodiments of the present invention, examples of which are illustrated in the accompanying drawings, wherein like or similar reference numerals refer to the same or similar elements or elements having the same or similar function throughout. The embodiments described below with reference to the accompanying drawings are illustrative only for the purpose of explaining the present invention, and are not to be construed as limiting the present invention.
The first embodiment:
referring to fig. 2, there is provided a VVC intra frame inter frame skipping method, including the steps of:
s100, encoding the input code stream by using encoders except VVC to obtain the intra-frame prediction mode RD-cost information of the CU blocks and the RD-cost information of the inter-frame prediction mode;
s200, obtaining a difference value between the RD-cost of the intra-frame prediction mode corresponding to the current CU block position and the RD-cost of the inter-frame prediction mode, and determining the VVC coding prediction mode of the current CU block.
According to the existing selection criteria of the optimal prediction mode, if the RD-cost of the intra prediction mode is much smaller than the RD-cost of the inter prediction mode, for example: the RD-cost of the intra prediction mode is equal to 1 and the RD-cost of the inter prediction mode is equal to 1000, then this block will use the intra prediction mode; when the reconstructed video is input to a VVC encoder and VVC encoded, the characteristics of the same CU block are unchanged, and the intra prediction mode is selected for this block at a high rate. Similarly, if the RD-cost of the inter prediction mode is much smaller than that of the intra prediction mode, the description thereof will not be repeated here.
The embodiment can utilize RD-cost information of an intra-frame prediction mode and RD-cost information of an inter-frame prediction mode of each CU block obtained by other video standards, then obtain a difference value between the RD-cost of the intra-frame prediction mode and the RD-cost of the inter-frame prediction mode corresponding to the current CU position in the VVC encoding process, and prejudge the prediction mode of the current CU block. For example, when the difference value between the RD-cost of the intra-frame prediction mode and the RD-cost of the inter-frame prediction mode is greater than a preset value, the RD-cost of the inter-frame prediction mode is considered to be far smaller than the RD-cost of the intra-frame prediction mode, and when VVC coding can be predicted, the RD-cost of the inter-frame prediction mode can be selected by a corresponding CU block at a high probability, so that the prediction mode of the VVC is predicted accurately, and the purposes of reducing the coding complexity of the VVC and improving the transcoding efficiency are achieved.
Specifically, obtaining a difference value between the RD-cost of the intra prediction mode corresponding to the current CU block position and the RD-cost of the inter prediction mode, and determining the prediction mode of the VVC coding of the current CU block, includes the steps of:
let RD-cost of intra prediction mode be JintraRD-cost of inter prediction mode is denoted as Jinter；
If Jintra>JinterAnd satisfies the following conditions:
Figure GDA0003160027800000061
generating an intra prediction mode skip flag; if Jintra<JinterAnd satisfies the following conditions:
Figure GDA0003160027800000062
generating an inter prediction mode skip flag, wherein TRatioIs a threshold value.
And according to the intra-frame prediction mode skip identification or the inter-frame prediction mode skip identification, performing intra-frame prediction mode skip operation or inter-frame prediction mode skip operation on the VVC-coded current CU block.
In particular, the threshold value TRatioComprises the steps of:
and (3) calculating:
Figure GDA0003160027800000071
wherein R ismaxOf RD-cost indicating intra-prediction mode and inter-prediction modeThe larger of RD-costs, RminThe smaller of the RD-cost representing the intra prediction mode and the RD-cost representing the inter prediction mode;
fitting the probability and the QP value to generate a threshold value TRatioWherein, QP is a quantization parameter input when encoding the input code stream.
Threshold value TRatioThe function of (1) is to judge that one of the RD-cost of the intra prediction mode and the RD-cost of the inter prediction mode is much larger than the other. Here, a Proportion probability is obtained first and then is fitted with the QP value, which has the advantages of better universality and robustness.
Preferably, the encoder other than VVC comprises: HEVC, AV1, AVs, VP9, or h.264 encoders. Can meet most encoders in the market, and improves the application range of the method.
Second embodiment:
with reference to fig. 3 and 4, a specific implementation flow based on the method of the first embodiment is provided, wherein an HEVC/h.265 encoder is taken as an example, as follows:
(1) inputting the YUV video into an HEVC/H.265 encoder, starting encoding to obtain an encoded reconstructed video and intermediate information in an encoding process, wherein the intermediate information comprises RD-cost of an intra-frame prediction mode and RD-cost of an inter-frame prediction mode of each CU block, and comparing the RD-cost of the intra-frame prediction mode of each CU block with the RD-cost of the inter-frame prediction mode. Wherein RD-cost is calculated by the following formula:
J＝D+λ*R
and D is a Distortion value Distoretation, a difference value is made between a reconstructed pixel value of each pixel of the current CU block and an original pixel value, absolute values of the difference values are taken, the difference values of all the absolute values of the pixels of the current CU block are added, and the value of D is finally obtained. λ is the encoder setting value, which will not be described in detail here. R is the number of bits used to encode the current CU block. J is the final calculated RD-cost value.
(2) Let RD-cost of intra prediction mode of CU block be JintraLet RD-cost of inter prediction mode of CU block be denoted as Jinter；
If Jintra>JinterAnd satisfies the following conditions:
Figure GDA0003160027800000081
the output flag bit is 1; otherwise, the output flag bit is 0.
Wherein, TRatio＝37.747×QP21583.6 XQP +18884, QP stands for quantization parameter, which is a constant value for the encoder input. The formula is calculated by counting the ratio probability between the smaller and larger of the difference between the RD-cost of the intra-frame prediction mode and the RD-cost of the inter-frame prediction mode in the case of 4 different input QPs (22, 27, 32, 37) of the input video, as shown in the following formula:
Figure GDA0003160027800000082
wherein R ismaxR is greater in RD-cost representing intra prediction mode than in RD-cost representing inter prediction modeminThe smaller of the RD-cost representing the intra prediction mode compared to the RD-cost of the inter prediction mode. Calculating the mean value of all the proportional data, and performing data fitting on the mean value and the QP value to obtain TRatioThe calculation formula of (2). The fitting relationship is shown in fig. 4.
(3) If Jintra<JinterAnd satisfies the following conditions:
Figure GDA0003160027800000083
the output flag bit is 3; otherwise, the output flag is 2.
It is to be noted that steps (2) and (3) are also performed in the VVC encoder.
(4) Inputting the reconstructed video obtained in the step (1) into a VVC encoder, and executing a VVC encoding process.
(5) And acquiring a prediction mode flag bit in HEVC corresponding to the current CU block.
(6) If the obtained HEVC prediction mode flag bit is 1, skipping the inter prediction mode, and executing the intra prediction mode: and calculating all RD-costs of the intra-frame prediction modes, and selecting the prediction mode of the smallest RD-cost as the optimal mode of the current CU block. Since the intra prediction mode procedure is well known in the art, it will not be described in detail here.
If the obtained HEVC prediction mode flag bit is equal to 3, skipping the intra prediction mode, and executing the inter prediction mode: the method comprises the steps of calculating RD-cost of the Affinine mode, the Merge mode and the Inter mode respectively, and selecting the mode with the minimum RD-cost as the optimal mode. Since the inter prediction mode procedure is well known in the art, it will not be described in detail herein.
The experiment was performed using the VVC official reference platform VTM7.0 and under the universal test conditions of jfet as follows:
at the encoder settings, the video sequence used for the test is the video sequence with the officially recommended sampling format YUV420P, using the settings in the default Lowdelay-P configuration. The coding performance is mainly evaluated by two indexes of BDBR and TR (Time Reduction), and the coding performance of the algorithm is evaluated by taking an original VTM7.0 encoder as a reference. The BDBR represents the difference between the code rates of the two encoding methods under the same objective quality, and is obtained by respectively encoding and calculating the code rate and PSNR (Peak Signal to Noise Ratio, which is an objective standard for evaluating images) of the same video under the values of four QP (Quantization Parameter) (22, 27, 32, 37). The BDBR can comprehensively reflect the code rate and the quality of the video, and represents the percentage of the code rate which can be saved by a better coding method under the same objective quality. When the BDBR is a negative value, the code rate is reduced and the performance is improved under the condition of representing the same PSNR (peak signal-to-noise ratio). A positive value indicates an increased code rate and a decreased performance. TR is used to measure the reduction degree of the fast algorithm to the encoding time based on the original encoder, and the calculation method is as follows:
Figure GDA0003160027800000091
wherein, T1Total encoding time, T, for applying the method of the invention to VTM7.00Is the sum of original VTM7.0And (4) coding time. When TR is negative it means that the encoder to which the method of the invention is added uses less time than an encoder to which the method of the invention is not added. Specific results are shown in table 1 below.
Sequence name BDBR TR
BasketballDrill_832x480_50 1.19％ -13.64％
BasketballPass_416x240_50 0.22％ -14.25％
Johnny_1280x720_60 -0.13％ -2.86％
PartyScene_832x480_50 0.45％ -17.48％
BasketballDrive_1920x1080_50 1.54％ -12.26％
Average 0.65％ -12.10％
TABLE 1
The test results without using the intermediate information are shown in table 2 below:
sequence name BDBR TR
BasketballDrill_832x480_50 2.03％ -4.82％
BasketballPass_416x240_50 0.15 -9.67％
Johnny_1280x720_60 -0.04％ 1.32％
PartyScene_832x480_50 0.40％ -9.55％
BasketballDrive_1920x1080_50 2.66％ -0.29％
Average 1.04％ -4.60％
TABLE 2
As can be seen from the above table, the experimental results obtained show a 12.10% reduction in time with a loss of 0.65% for BDBR (Bjotegaard Delta Bit rate) compared to an encoder without the addition of the method of the invention.
Therefore, the implementation method can effectively reduce the complexity generated by VVC coding in the transcoding process and accurately predict the VVC prediction mode by using the RD-cost information of the intra-frame prediction mode and the RD-cost information of the inter-frame prediction mode of each CU block obtained by a video standard, so that the coding complexity of the VVC is greatly reduced and the transcoding efficiency is improved under the condition of low quality loss.
The third embodiment:
referring to fig. 5, there is provided a VVC intra frame inter frame skipping system, including: a first encoder module and a VVC encoder module;
the first encoder module is used for encoding the input code stream to obtain the intra-frame prediction mode RD-cost information of the CU block and the RD-cost information of the inter-frame prediction mode;
and the VVC encoder module is used for acquiring a difference value between the RD-cost of the intra-frame prediction mode corresponding to the current CU block position and the RD-cost of the inter-frame prediction mode and determining the prediction mode of the current CU block.
Specifically, the first encoder module includes 1 encoder, and the encoder may be: HEVC, AV1, AVs, VP9, or h.264 encoders. The VVC encoder block includes 1 VVC encoder, such as VTM 7.0.
It should be noted that the present embodiment is based on the same inventive concept as the first embodiment, and therefore the beneficial effects of the first embodiment are also applicable to the present embodiment, which will not be described in detail herein.
The fourth embodiment:
referring to fig. 6, a VVC intra frame inter frame skipping device is provided, which may be any type of smart terminal, such as a mobile phone, a tablet computer, a personal computer, and the like.
Specifically, the VVC intra frame inter frame skipping apparatus includes: one or more control processors and memory, one control processor being exemplified in fig. 6. The control processor and the memory may be connected by a bus or other means, as exemplified by the bus connection in fig. 6.
The memory, which is a non-transitory computer-readable storage medium, may be used to store non-transitory software programs, non-transitory computer-executable programs, and modules, such as program instructions/modules corresponding to the VVC intra-frame inter-frame skipping apparatus in the embodiment of the present invention, and the control processor implements various functional applications and data processing of the VVC intra-frame inter-frame skipping system in the foregoing system embodiment by running the non-transitory software programs, instructions, and modules stored in the memory, so as to implement the VVC intra-frame inter-frame skipping method in the foregoing method embodiment.
The memory may include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application program required for at least one function; the data storage area may store data generated by a VVC intra frame inter frame skipping system of the above-described system embodiments. Further, the memory may include high speed random access memory, and may also include non-transitory memory, such as at least one disk storage device, flash memory device, or other non-transitory solid state storage device. In some embodiments, the memory optionally includes memory remotely located from the control processor, and the remote memory may be connected to the VVC intra frame inter frame skipping device via a network. Examples of such networks include, but are not limited to, the internet, intranets, local area networks, mobile communication networks, and combinations thereof.
The one or more modules are stored in the memory and, when executed by the one or more control processors, perform a VVC intra frame inter frame skipping method of the above-described method embodiments, e.g., performing method steps S100 to S200 of fig. 2 described above.
Fifth embodiment:
a computer-readable storage medium is provided, which stores computer-executable instructions that are executed by one or more control processors, e.g., by one of the control processors in fig. 6, and that cause the one or more control processors to perform a VVC intra frame inter frame skipping method in the above-described method embodiments, e.g., to perform the above-described method steps S100 to S200 in fig. 2.
Through the above description of the embodiments, those skilled in the art can clearly understand that the embodiments can be implemented by software plus a general hardware platform. Those skilled in the art will appreciate that all or part of the processes of the methods of the above embodiments may be implemented by hardware related to instructions of a computer program, which may be stored in a computer readable storage medium, and when executed, may include the processes of the embodiments of the methods described above. The storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.
In the description herein, references to the description of the term "one embodiment," "some embodiments," "an illustrative embodiment," "an example," "a specific example," or "some examples" or the like mean that a particular feature, structure, material, or characteristic described in connection with the embodiment or example is included in at least one embodiment or example of the invention. In this specification, the schematic representations of the terms used above do not necessarily refer to the same embodiment or example. Furthermore, the particular features, structures, materials, or characteristics described may be combined in any suitable manner in any one or more embodiments or examples.
While embodiments of the invention have been shown and described, it will be understood by those of ordinary skill in the art that: various changes, modifications, substitutions and alterations can be made to the embodiments without departing from the principles and spirit of the invention, the scope of which is defined by the claims and their equivalents.

Claims (6)

1. A VVC intra-frame inter-frame skipping method is characterized by comprising the following steps:
encoding the input code stream by an encoder except VVC to obtain the intra-frame prediction mode RD-cost information of the CU block and the RD-cost information of the inter-frame prediction mode;
obtaining a difference value between RD-cost of an intra prediction mode corresponding to the current CU block position and RD-cost of an inter prediction mode, and determining a VVC-coded prediction mode of the current CU block:
recording RD-cost of the intra prediction mode as JintraRD-cost of the inter prediction mode is denoted as Jinter；
If Jintra＞JinterAnd satisfies the following conditions:
Figure FDA0003160027790000011
generating an intra prediction mode skip flag; if Jintra＜JinterAnd satisfies the following conditions:
Figure FDA0003160027790000012
generating an inter prediction mode skip flag, wherein TRatioIs a threshold value;
and according to the intra-frame prediction mode skip identification or the inter-frame prediction mode skip identification, performing intra-frame prediction mode skip operation or inter-frame prediction mode skip operation on the VVC-coded current CU block.
2. The VVC intra-frame inter-frame skipping method of claim 1, wherein the threshold T is set according to claim 1RatioComprises the steps of:
and (3) calculating:
Figure FDA0003160027790000013
wherein R ismaxRD-cost representing the intra prediction mode and the inter prediction modeThe larger of RD-costs, RminThe lesser of the RD-cost representing the intra-prediction mode and the RD-cost representing the inter-prediction mode;
fitting the Proport and the QP value to generate the threshold value TRatioWherein, QP is a quantization parameter input when encoding the input code stream.
3. The VVC intra-frame inter-frame skip method of claim 1, wherein the encoder other than the VVC comprises: HEVC, AV1, AVs, VP9, or h.264 encoders.
4. A VVC intra frame inter frame skipping system, comprising: a first encoder module and a VVC encoder module;
the first encoder module is used for encoding an input code stream to obtain the intra-frame prediction mode RD-cost information of the CU block and the RD-cost information of the inter-frame prediction mode;
the VVC encoder module is used for obtaining a difference value between RD-cost of an intra-frame prediction mode corresponding to the current CU block position and RD-cost of an inter-frame prediction mode, and determining the prediction mode of the current CU block:
recording RD-cost of the intra prediction mode as JintraRD-cost of the inter prediction mode is denoted as Jinter；
If Jintra＞JinterAnd satisfies the following conditions:
Figure FDA0003160027790000021
generating an intra prediction mode skip flag; if Jintra＜JinterAnd satisfies the following conditions:
Figure FDA0003160027790000022
generating an inter prediction mode skip flag, wherein TRatioIs a threshold value;
and according to the intra-frame prediction mode skip identification or the inter-frame prediction mode skip identification, performing intra-frame prediction mode skip operation or inter-frame prediction mode skip operation on the VVC-coded current CU block.
5. A VVC intraframe interframe optimization apparatus, comprising: at least one control processor and a memory for communicative connection with the at least one control processor; the memory stores instructions executable by the at least one control processor to enable the at least one control processor to perform a VVC intra frame skipping method as claimed in any one of claims 1 to 3.
6. A computer-readable storage medium having stored thereon computer-executable instructions for causing a computer to perform a VVC intra frame inter frame skipping method as claimed in any one of claims 1 to 3.
CN202010339113.XA 2020-04-26 2020-04-26 VVC intra-frame inter-frame skipping method, system, equipment and storage medium Active CN111586406B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010339113.XA CN111586406B (en) 2020-04-26 2020-04-26 VVC intra-frame inter-frame skipping method, system, equipment and storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010339113.XA CN111586406B (en) 2020-04-26 2020-04-26 VVC intra-frame inter-frame skipping method, system, equipment and storage medium

Publications (2)

Publication Number Publication Date
CN111586406A CN111586406A (en) 2020-08-25
CN111586406B true CN111586406B (en) 2021-10-15

Family

ID=72114096

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010339113.XA Active CN111586406B (en) 2020-04-26 2020-04-26 VVC intra-frame inter-frame skipping method, system, equipment and storage medium

Country Status (1)

Country Link
CN (1) CN111586406B (en)

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112689145B (en) * 2020-12-07 2024-02-13 中南大学 Method for selecting quick intra mode of VVC intra coding
CN114584768A (en) * 2022-02-17 2022-06-03 百果园技术(新加坡)有限公司 Video coding control method, device, equipment and storage medium

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105959611A (en) * 2016-07-14 2016-09-21 同观科技（深圳）有限公司 Adaptive H264-to-HEVC (High Efficiency Video Coding) inter-frame fast transcoding method and apparatus
CN106534849A (en) * 2016-12-30 2017-03-22 杭州当虹科技有限公司 Fast HEVC interframe coding method
KR20180097908A (en) * 2017-02-24 2018-09-03 한국전자통신연구원 Method and apparatus for determining prediction mode
CN108810531A (en) * 2017-05-03 2018-11-13 腾讯科技（深圳）有限公司 Video coding processing method, device and electronic equipment
CN109561304A (en) * 2018-11-16 2019-04-02 建湖云飞数据科技有限公司 A kind of image encoding method

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103442228B (en) * 2013-08-19 2016-05-25 四川大学 Code-transferring method and transcoder thereof in from standard H.264/AVC to the fast frame of HEVC standard
WO2016175550A1 (en) * 2015-04-27 2016-11-03 엘지전자 주식회사 Method for processing video signal and device for same
CN106878751B (en) * 2015-12-11 2022-01-14 北京三星通信技术研究有限公司 Identification method, processing method and device of video intra-frame coding mode

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN105959611A (en) * 2016-07-14 2016-09-21 同观科技（深圳）有限公司 Adaptive H264-to-HEVC (High Efficiency Video Coding) inter-frame fast transcoding method and apparatus
CN106534849A (en) * 2016-12-30 2017-03-22 杭州当虹科技有限公司 Fast HEVC interframe coding method
KR20180097908A (en) * 2017-02-24 2018-09-03 한국전자통신연구원 Method and apparatus for determining prediction mode
CN108810531A (en) * 2017-05-03 2018-11-13 腾讯科技（深圳）有限公司 Video coding processing method, device and electronic equipment
CN109561304A (en) * 2018-11-16 2019-04-02 建湖云飞数据科技有限公司 A kind of image encoding method

Also Published As

Publication number Publication date
CN111586406A (en) 2020-08-25

Similar Documents

Publication Publication Date Title
KR101513379B1 (en) Adaptive motion vector resolution signaling for video coding
CN114501010B (en) Image encoding method, image decoding method and related devices
CN107566846B (en) Video coding skipping mode decision method, device, equipment and storage medium
CN111355951B (en) Video decoding method, device and decoding equipment
WO2021004153A1 (en) Image prediction method, coder, decoder, and storage medium
CN113727106B (en) Video encoding and decoding methods, devices, electronic equipment and storage medium
CN111327904B (en) Image reconstruction method and device
CN111586406B (en) VVC intra-frame inter-frame skipping method, system, equipment and storage medium
CN111385572B (en) Prediction mode determining method and device, encoding device and decoding device
CN110351552B (en) Fast coding method in video coding
WO2022228104A1 (en) Video transcoding method and apparatus, and electronic device and storage medium
WO2021185257A1 (en) Image coding method, image decoding method and related apparatuses
CN110365975A (en) A kind of AVS2 video encoding and decoding standard prioritization scheme
CN112913236A (en) Encoder, decoder and corresponding methods using compressed MV storage
WO2022116246A1 (en) Inter-frame prediction method, video encoding and decoding method, apparatus, and medium
CN109151467A (en) Screen content based on image block activity encodes interframe mode quick selecting method
TW202106009A (en) Video encoder, video decoder, and related methods
CN115714861A (en) Video decoder and corresponding method
KR101443865B1 (en) Method and apparatus for inter prediction
WO2022022622A1 (en) Image coding method, image decoding method, and related apparatus
WO2021027799A1 (en) Video coder and qp setting method
CN111263158B (en) Multi-transformation-core rapid processing method based on spatial correlation
WO2020224476A1 (en) Image division method, apparatus and device
CN116982262A (en) State transition for dependent quantization in video coding
WO2020147514A1 (en) Video coder, video decoder, and corresponding method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant